[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:40:41 dist-test-slave-fgb3 krb5kdc[16573](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:40:41 dist-test-slave-fgb3 krb5kdc[16573](info): set up 2 sockets
Aug 06 10:40:41 dist-test-slave-fgb3 krb5kdc[16573](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 10:40:42.199047 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.007s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:40:42 dist-test-slave-fgb3 krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:40:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:40:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:40:42.387105 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:45757
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:45757
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:42.812830 16592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:42.813265 16592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:42.813382 16592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:42.820663 16592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:40:42.820775 16592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:42.820828 16592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:42.820884 16592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:40:42.820935 16592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:40:42.831401 16592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:45757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:45757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:42.833334 16592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:42.835341 16592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:42.862531 16599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:42.862565 16600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:42.862597 16603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:42.864939 16592 server_base.cc:1034] running on GCE node
I20260806 10:40:42.866276 16592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:42.868782 16592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:42.870024 16592 hybrid_clock.cc:648] HybridClock initialized: now 1786012842869915 us; error 93 us; skew 500 ppm
I20260806 10:40:42.870678 16592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:42 dist-test-slave-fgb3 krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012842, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:42.874825 16592 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:40:42.877466 16592 webserver.cc:460] Webserver started at http://127.16.45.126:35063/ using document root <none> and password file <none>
I20260806 10:40:42.878732 16592 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:42.878891 16592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:42.879429 16592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:42.884152 16592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "ba64b2ab81924290a3c64d5700d6d194"
format_stamp: "Formatted at 2026-08-06 10:40:42 on dist-test-slave-fgb3"
server_key: "fda96a41ac5f9c34795de21550a6f843"
server_key_iv: "aa64a507e7635e0abe8cb530a7354c79"
server_key_version: "encryptionkey@0"
I20260806 10:40:42.885324 16592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "ba64b2ab81924290a3c64d5700d6d194"
format_stamp: "Formatted at 2026-08-06 10:40:42 on dist-test-slave-fgb3"
server_key: "fda96a41ac5f9c34795de21550a6f843"
server_key_iv: "aa64a507e7635e0abe8cb530a7354c79"
server_key_version: "encryptionkey@0"
I20260806 10:40:42.893862 16592 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260806 10:40:42.900085 16612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:42.902271 16592 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:40:42.902601 16592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "ba64b2ab81924290a3c64d5700d6d194"
format_stamp: "Formatted at 2026-08-06 10:40:42 on dist-test-slave-fgb3"
server_key: "fda96a41ac5f9c34795de21550a6f843"
server_key_iv: "aa64a507e7635e0abe8cb530a7354c79"
server_key_version: "encryptionkey@0"
I20260806 10:40:42.902808 16592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:42.937750 16592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:42.943588 16592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:42.944087 16592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:42.971494 16592 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:45757
I20260806 10:40:42.971623 16686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:45757 every 8 connection(s)
I20260806 10:40:42.973938 16592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:40:42.978269 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 16592
I20260806 10:40:42.978717 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:40:42.981679 16565 external_mini_cluster.cc:1428] Setting key d783406b8675b61e5377c83f7a8cd269
I20260806 10:40:42.982610 16687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:43.005921 16687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194: Bootstrap starting.
I20260806 10:40:43.014072 16687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:43.016523 16687 log.cc:824] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:43.022706 16687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194: No bootstrap required, opened a new log
Aug 06 10:40:43 dist-test-slave-fgb3 krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:43.035879 16687 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba64b2ab81924290a3c64d5700d6d194" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45757 } }
I20260806 10:40:43.036757 16687 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:43.036936 16687 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba64b2ab81924290a3c64d5700d6d194, State: Initialized, Role: FOLLOWER
I20260806 10:40:43.037427 16692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:42.989498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52350 (local address 127.16.45.126:45757)
0806 10:40:42.990825 (+ 1327us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:42.990837 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:42.990884 (+ 47us) server_negotiation.cc:407] Connection header received
0806 10:40:43.004331 (+ 13447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:43.004354 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:43.004813 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:43.005145 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:43.010496 (+ 5351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:43.012575 (+ 2079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:43.015629 (+ 3054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:43.016488 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:43.016751 (+ 263us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:43.026431 (+ 9680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:43.026445 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:43.026465 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:43.026517 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:43.030286 (+ 3769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:43.031594 (+ 1308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:43.031602 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:43.031609 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:43.031870 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:43.032465 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:43.032469 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:43.032471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:43.033431 (+ 960us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:43.033782 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:43.035083 (+ 1301us) server_negotiation.cc:299] Negotiation successful
0806 10:40:43.035462 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1048,"thread_start_us":770,"threads_started":1}
I20260806 10:40:43.038280 16687 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba64b2ab81924290a3c64d5700d6d194" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45757 } }
I20260806 10:40:43.038806 16687 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:40:43.039173 16687 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:40:43.039479 16687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:43.042723 16687 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba64b2ab81924290a3c64d5700d6d194" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45757 } }
I20260806 10:40:43.043902 16687 leader_election.cc:302] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba64b2ab81924290a3c64d5700d6d194; no voters:
I20260806 10:40:43.044999 16687 leader_election.cc:288] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:40:43.045389 16695 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:40:43.046945 16695 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [term 1 LEADER]: Becoming Leader. State: Replica: ba64b2ab81924290a3c64d5700d6d194, State: Running, Role: LEADER
I20260806 10:40:43.047839 16695 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba64b2ab81924290a3c64d5700d6d194" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45757 } }
I20260806 10:40:43.049342 16687 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:40:43.053702 16699 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba64b2ab81924290a3c64d5700d6d194. Latest consensus state: current_term: 1 leader_uuid: "ba64b2ab81924290a3c64d5700d6d194" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba64b2ab81924290a3c64d5700d6d194" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45757 } } }
I20260806 10:40:43.053671 16697 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba64b2ab81924290a3c64d5700d6d194" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba64b2ab81924290a3c64d5700d6d194" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45757 } } }
I20260806 10:40:43.054234 16699 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [sys.catalog]: This master's current role is: LEADER
I20260806 10:40:43.054247 16697 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194 [sys.catalog]: This master's current role is: LEADER
I20260806 10:40:43.055630 16706 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:40:43.067327 16706 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:40:43.084133 16706 catalog_manager.cc:1347] Generated new cluster ID: 9b0cdd1abb60457b9374b585ccaecf74
I20260806 10:40:43.084286 16706 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:40:43.096760 16706 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:40:43.098518 16706 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:40:43.106868 16706 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba64b2ab81924290a3c64d5700d6d194: Generated new TSK 0
I20260806 10:40:43.108125 16706 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:40:43.177630 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45757
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:43.603718 16731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:43.604218 16731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:43.604417 16731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:43.613319 16731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:43.613525 16731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:43.613724 16731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:40:43.625376 16731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45757
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:43.626840 16731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:43.628451 16731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:43.648694 16737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:43.648900 16738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:43.648895 16740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:43.650714 16731 server_base.cc:1034] running on GCE node
I20260806 10:40:43.651429 16731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:43.652957 16731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:43.654228 16731 hybrid_clock.cc:648] HybridClock initialized: now 1786012843654142 us; error 85 us; skew 500 ppm
I20260806 10:40:43.654644 16731 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:43 dist-test-slave-fgb3 krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012843, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:43.658576 16731 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:40:43.660192 16731 webserver.cc:460] Webserver started at http://127.16.45.65:42349/ using document root <none> and password file <none>
I20260806 10:40:43.661062 16731 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:43.661193 16731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:43.661512 16731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:43.664763 16731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "a6e9aa603fe04c1f9b83136ce4bbf013"
format_stamp: "Formatted at 2026-08-06 10:40:43 on dist-test-slave-fgb3"
server_key: "fa63dc81b6a9c672eed228aa8ef5e687"
server_key_iv: "ad83fdfde561da1c7ccc9711cbce7f85"
server_key_version: "encryptionkey@0"
I20260806 10:40:43.665753 16731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "a6e9aa603fe04c1f9b83136ce4bbf013"
format_stamp: "Formatted at 2026-08-06 10:40:43 on dist-test-slave-fgb3"
server_key: "fa63dc81b6a9c672eed228aa8ef5e687"
server_key_iv: "ad83fdfde561da1c7ccc9711cbce7f85"
server_key_version: "encryptionkey@0"
I20260806 10:40:43.671562 16731 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 10:40:43.675412 16749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:43.676764 16731 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:40:43.676941 16731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "a6e9aa603fe04c1f9b83136ce4bbf013"
format_stamp: "Formatted at 2026-08-06 10:40:43 on dist-test-slave-fgb3"
server_key: "fa63dc81b6a9c672eed228aa8ef5e687"
server_key_iv: "ad83fdfde561da1c7ccc9711cbce7f85"
server_key_version: "encryptionkey@0"
I20260806 10:40:43.677193 16731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:43.709321 16731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:43.714619 16731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:43.714905 16731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:43.716336 16731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:40:43.718286 16731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:40:43.718394 16731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 10:40:43.718617 16731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:40:43.718732 16731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:43.773820 16731 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:32985
I20260806 10:40:43.773856 16914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:32985 every 8 connection(s)
I20260806 10:40:43.775254 16731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:40:43.782920 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 16731
I20260806 10:40:43.783551 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:40:43.784190 16565 external_mini_cluster.cc:1428] Setting key d049f6ab9c83ec58c4f80280a4dfccad
Aug 06 10:40:43 dist-test-slave-fgb3 krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012843, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:43.800256 16923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:43.779846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:45757 (local address 127.16.45.65:53205)
0806 10:40:43.780850 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:43.780898 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:43.783238 (+ 2340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:43.784171 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:43.784180 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:43.785006 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:43.785848 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:43.785871 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:43.787047 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:43.787051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:43.788462 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:43.788475 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:43.789347 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:43.789356 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:43.789659 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:43.790411 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:43.790442 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:43.792760 (+ 2318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:43.796075 (+ 3315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:43.796085 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:43.796100 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:43.796621 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:43.796986 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:43.796991 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:43.796994 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:43.797191 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:43.797788 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:43.797797 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:43.798212 (+ 415us) client_negotiation.cc:769] Sending connection context
0806 10:40:43.798614 (+ 402us) client_negotiation.cc:240] Negotiation successful
0806 10:40:43.799184 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":719,"thread_start_us":507,"threads_started":1}
I20260806 10:40:43.801800 16921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:43.779267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:53205 (local address 127.16.45.126:45757)
0806 10:40:43.779784 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:43.779789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:43.781035 (+ 1246us) server_negotiation.cc:407] Connection header received
0806 10:40:43.783602 (+ 2567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:43.783607 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:43.783704 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:43.783890 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:43.786048 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:43.786893 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:43.788605 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:43.789071 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:43.789191 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:43.792987 (+ 3796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:43.792992 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:43.792996 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:43.793027 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:43.795903 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:43.796740 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:43.796744 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:43.796747 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:43.796880 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:43.797299 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:43.797303 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:43.797305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:43.797657 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:43.797795 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:43.800624 (+ 2829us) server_negotiation.cc:299] Negotiation successful
0806 10:40:43.800874 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":266,"threads_started":1}
I20260806 10:40:43.804299 16917 heartbeater.cc:347] Connected to a master server at 127.16.45.126:45757
I20260806 10:40:43.804730 16917 heartbeater.cc:464] Registering TS with master...
I20260806 10:40:43.805799 16917 heartbeater.cc:511] Master 127.16.45.126:45757 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
I20260806 10:40:43.810117 16637 ts_manager.cc:194] Registered new tserver with Master: a6e9aa603fe04c1f9b83136ce4bbf013 (127.16.45.65:32985)
I20260806 10:40:43.812618 16637 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:53205
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
W20260806 10:40:44.773782 16565 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.16.45.66: real 0.987s user 0.009s sys 0.006s
I20260806 10:40:44.774830 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45757
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:40:44.816341 16917 heartbeater.cc:503] Master 127.16.45.126:45757 was elected leader, sending a full tablet report...
W20260806 10:40:45.192498 16929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:45.192817 16929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:45.192947 16929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:45.200480 16929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:45.200616 16929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:45.200843 16929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:40:45.211139 16929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45757
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:45.212627 16929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:45.214010 16929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:45.228575 16935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:45.228703 16936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:45.228729 16938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:45.229677 16929 server_base.cc:1034] running on GCE node
I20260806 10:40:45.230360 16929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:45.231343 16929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:45.232554 16929 hybrid_clock.cc:648] HybridClock initialized: now 1786012845232495 us; error 47 us; skew 500 ppm
I20260806 10:40:45.232868 16929 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:45 dist-test-slave-fgb3 krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012845, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:45.236137 16929 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:40:45.237677 16929 webserver.cc:460] Webserver started at http://127.16.45.66:34727/ using document root <none> and password file <none>
I20260806 10:40:45.238430 16929 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:45.238556 16929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:45.238873 16929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:45.242568 16929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "661e0c20c6c040ec9761628538b7a2fe"
format_stamp: "Formatted at 2026-08-06 10:40:45 on dist-test-slave-fgb3"
server_key: "2d341fe8390bab996f031462780ea0d1"
server_key_iv: "446e4971c1030eeea8e59740af6fe25c"
server_key_version: "encryptionkey@0"
I20260806 10:40:45.243496 16929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "661e0c20c6c040ec9761628538b7a2fe"
format_stamp: "Formatted at 2026-08-06 10:40:45 on dist-test-slave-fgb3"
server_key: "2d341fe8390bab996f031462780ea0d1"
server_key_iv: "446e4971c1030eeea8e59740af6fe25c"
server_key_version: "encryptionkey@0"
I20260806 10:40:45.249477 16929 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260806 10:40:45.253330 16949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:45.254742 16929 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 10:40:45.254904 16929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "661e0c20c6c040ec9761628538b7a2fe"
format_stamp: "Formatted at 2026-08-06 10:40:45 on dist-test-slave-fgb3"
server_key: "2d341fe8390bab996f031462780ea0d1"
server_key_iv: "446e4971c1030eeea8e59740af6fe25c"
server_key_version: "encryptionkey@0"
I20260806 10:40:45.255088 16929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:45.269273 16929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:45.273780 16929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:45.274070 16929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:45.275120 16929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:40:45.276554 16929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:40:45.276643 16929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:45.276777 16929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:40:45.276837 16929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:45.325053 16929 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:33343
I20260806 10:40:45.325094 17120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:33343 every 8 connection(s)
I20260806 10:40:45.326503 16929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:40:45.335803 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 16929
I20260806 10:40:45.335991 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:40:45.336524 16565 external_mini_cluster.cc:1428] Setting key 071e35c2132181b345293e4852248afb
Aug 06 10:40:45 dist-test-slave-fgb3 krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012845, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:45.348966 17124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:45.329211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:41171 (local address 127.16.45.126:45757)
0806 10:40:45.329640 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:45.329645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:45.330610 (+ 965us) server_negotiation.cc:407] Connection header received
0806 10:40:45.332762 (+ 2152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:45.332768 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:45.332853 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:45.332961 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:45.334760 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:45.335669 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:45.337734 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:45.338516 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:45.338632 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:45.342657 (+ 4025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:45.342662 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:45.342665 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:45.342699 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:45.345431 (+ 2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:45.346265 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:45.346269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:45.346271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:45.346442 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:45.346977 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:45.346982 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:45.346986 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:45.347286 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:45.347425 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:45.348232 (+ 807us) server_negotiation.cc:299] Negotiation successful
0806 10:40:45.348520 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":228,"threads_started":1}
I20260806 10:40:45.350147 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:45.329676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:45757 (local address 127.16.45.66:41171)
0806 10:40:45.330431 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:45.330492 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:45.332465 (+ 1973us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:45.333236 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:45.333245 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:45.333891 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:45.334581 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:45.334603 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:45.335844 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:45.335848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:45.337606 (+ 1758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:45.337621 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:45.338745 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:45.338753 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:45.338992 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:45.339686 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:45.339709 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:45.342408 (+ 2699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:45.345607 (+ 3199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:45.345617 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:45.345636 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:45.346135 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:45.346547 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:45.346552 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:45.346556 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:45.346858 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:45.347416 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:45.347424 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:45.347837 (+ 413us) client_negotiation.cc:769] Sending connection context
0806 10:40:45.348094 (+ 257us) client_negotiation.cc:240] Negotiation successful
0806 10:40:45.348697 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":309,"threads_started":1}
I20260806 10:40:45.351877 17121 heartbeater.cc:347] Connected to a master server at 127.16.45.126:45757
I20260806 10:40:45.352262 17121 heartbeater.cc:464] Registering TS with master...
I20260806 10:40:45.353416 17121 heartbeater.cc:511] Master 127.16.45.126:45757 requested a full tablet report, sending...
I20260806 10:40:45.355171 16637 ts_manager.cc:194] Registered new tserver with Master: 661e0c20c6c040ec9761628538b7a2fe (127.16.45.66:33343)
I20260806 10:40:45.356020 16637 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:41171
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
W20260806 10:40:45.445112 16565 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.16.45.67: real 0.106s user 0.003s sys 0.017s
I20260806 10:40:45.446069 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45757
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:45.854588 17130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:45.854889 17130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:45.855033 17130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:45.862857 17130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:45.862990 17130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:45.863162 17130 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:40:45.873261 17130 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45757
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:45.874651 17130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:45.876003 17130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:45.889982 17137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:45.890024 17138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:45.889950 17141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:45.891393 17130 server_base.cc:1034] running on GCE node
I20260806 10:40:45.892004 17130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:45.893010 17130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:45.894227 17130 hybrid_clock.cc:648] HybridClock initialized: now 1786012845894154 us; error 62 us; skew 500 ppm
I20260806 10:40:45.894572 17130 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:45 dist-test-slave-fgb3 krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012845, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:45.897811 17130 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:40:45.899510 17130 webserver.cc:460] Webserver started at http://127.16.45.67:44995/ using document root <none> and password file <none>
I20260806 10:40:45.900207 17130 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:45.900331 17130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:45.900676 17130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:45.903765 17130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "426a2584665e4c03af6dfec531dfc6cc"
format_stamp: "Formatted at 2026-08-06 10:40:45 on dist-test-slave-fgb3"
server_key: "074bb7dde35e2a1e406713cb78f4e4a0"
server_key_iv: "155c9d15064ba0378555971a29454d57"
server_key_version: "encryptionkey@0"
I20260806 10:40:45.904531 17130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "426a2584665e4c03af6dfec531dfc6cc"
format_stamp: "Formatted at 2026-08-06 10:40:45 on dist-test-slave-fgb3"
server_key: "074bb7dde35e2a1e406713cb78f4e4a0"
server_key_iv: "155c9d15064ba0378555971a29454d57"
server_key_version: "encryptionkey@0"
I20260806 10:40:45.910154 17130 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 10:40:45.913854 17154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:45.915336 17130 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:40:45.915503 17130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "426a2584665e4c03af6dfec531dfc6cc"
format_stamp: "Formatted at 2026-08-06 10:40:45 on dist-test-slave-fgb3"
server_key: "074bb7dde35e2a1e406713cb78f4e4a0"
server_key_iv: "155c9d15064ba0378555971a29454d57"
server_key_version: "encryptionkey@0"
I20260806 10:40:45.915697 17130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:45.935153 17130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:45.939616 17130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:45.939941 17130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:45.941005 17130 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:40:45.942442 17130 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:40:45.942520 17130 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:45.942646 17130 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:40:45.942699 17130 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:45.987782 17130 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:43135
I20260806 10:40:45.987815 17339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:43135 every 8 connection(s)
I20260806 10:40:45.989073 17130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:40:45.997987 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 17130
I20260806 10:40:45.998164 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:40:45.998672 16565 external_mini_cluster.cc:1428] Setting key 2d619df7c97400346a4d39e152dece8a
Aug 06 10:40:46 dist-test-slave-fgb3 krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012845, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:46.009511 17344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:45.991710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:39659 (local address 127.16.45.126:45757)
0806 10:40:45.992175 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:45.992180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:45.993215 (+ 1035us) server_negotiation.cc:407] Connection header received
0806 10:40:45.995165 (+ 1950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:45.995171 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:45.995264 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:45.995355 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:45.996865 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:45.997600 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:45.999332 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:45.999794 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:45.999910 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:46.003889 (+ 3979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:46.003895 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:46.003898 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:46.003931 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:46.006499 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:46.007219 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:46.007223 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:46.007226 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:46.007350 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:46.007760 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:46.007764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:46.007766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:46.008032 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:46.008160 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:46.008893 (+ 733us) server_negotiation.cc:299] Negotiation successful
0806 10:40:46.009124 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":238,"threads_started":1}
I20260806 10:40:46.010478 17345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:45.992262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:45757 (local address 127.16.45.67:39659)
0806 10:40:45.993054 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:45.993095 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:45.994875 (+ 1780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:45.995610 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:45.995618 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:45.996137 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:45.996698 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:45.996716 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:45.997750 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:45.997755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:45.999194 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:45.999208 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:46.000050 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:46.000059 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:46.000360 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:46.001026 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:46.001064 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:46.003687 (+ 2623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:46.006625 (+ 2938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:46.006635 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:46.006651 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:46.007101 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:46.007459 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:46.007463 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:46.007467 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:46.007649 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:46.008152 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:46.008160 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:46.008497 (+ 337us) client_negotiation.cc:769] Sending connection context
0806 10:40:46.008787 (+ 290us) client_negotiation.cc:240] Negotiation successful
0806 10:40:46.009306 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":369,"threads_started":1}
I20260806 10:40:46.012049 17340 heartbeater.cc:347] Connected to a master server at 127.16.45.126:45757
I20260806 10:40:46.012391 17340 heartbeater.cc:464] Registering TS with master...
I20260806 10:40:46.013209 17340 heartbeater.cc:511] Master 127.16.45.126:45757 requested a full tablet report, sending...
I20260806 10:40:46.014827 16637 ts_manager.cc:194] Registered new tserver with Master: 426a2584665e4c03af6dfec531dfc6cc (127.16.45.67:43135)
I20260806 10:40:46.015793 16637 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:39659
I20260806 10:40:46.015859 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 10:40:46 dist-test-slave-fgb3 krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012846, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 10:40:46 dist-test-slave-fgb3 krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012846, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:40:46.075393 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:46.057298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39176 (local address 127.16.45.65:32985)
0806 10:40:46.058129 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:46.058137 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:46.058163 (+ 26us) server_negotiation.cc:407] Connection header received
0806 10:40:46.058241 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:46.058248 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:46.058517 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:46.058781 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:46.060286 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:46.061294 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:46.062878 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:46.063588 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:46.063735 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:46.068290 (+ 4555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:46.068303 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:46.068318 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:46.068357 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:46.071764 (+ 3407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:46.072801 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:46.072810 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:46.072813 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:46.073030 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:46.073513 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:46.073517 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:46.073519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:46.073930 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:46.074228 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:46.074574 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 10:40:46.074856 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":457,"threads_started":1}
W20260806 10:40:46.077054 16787 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39176
Aug 06 10:40:46 dist-test-slave-fgb3 krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 10:40:46 dist-test-slave-fgb3 krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:40:46.129823 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:46.114728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39188 (local address 127.16.45.65:32985)
0806 10:40:46.114934 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:46.114941 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:46.115306 (+ 365us) server_negotiation.cc:407] Connection header received
0806 10:40:46.115492 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:46.115496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:46.115633 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:46.115727 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:46.117140 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:46.117858 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:46.119193 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:46.119694 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:46.119810 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:46.124088 (+ 4278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:46.124095 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:46.124098 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:46.124135 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:46.127160 (+ 3025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:46.127918 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:46.127922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:46.127925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:46.128055 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:46.128389 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:46.128392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:46.128394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:46.128644 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:46.128910 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:46.129182 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 10:40:46.129398 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 10:40:46.131795 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16731
I20260806 10:40:46.145714 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:46.132801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39194 (local address 127.16.45.65:32985)
0806 10:40:46.133012 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:46.133018 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:46.133331 (+ 313us) server_negotiation.cc:407] Connection header received
0806 10:40:46.133466 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:46.133470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:46.133528 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:46.133611 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:46.134897 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:46.135637 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:46.136983 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:46.137711 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:46.137804 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:46.140460 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:46.140465 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:46.140468 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:46.140498 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:46.143203 (+ 2705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:46.143873 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:46.143876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:46.143878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:46.144038 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:46.144376 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:46.144380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:46.144382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:46.144715 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:46.144913 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:46.145120 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 10:40:46.145289 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 10:40:46.146530 16908 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:40:46.234848 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 16731
I20260806 10:40:46.256197 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16929
Aug 06 10:40:46 dist-test-slave-fgb3 krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:40:46.271164 17363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:46.257056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46882 (local address 127.16.45.66:33343)
0806 10:40:46.257724 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:46.257731 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:46.257757 (+ 26us) server_negotiation.cc:407] Connection header received
0806 10:40:46.257818 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:46.257825 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:46.258053 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:46.258179 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:46.259448 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:46.260494 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:46.261654 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:46.262246 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:46.262372 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:46.266180 (+ 3808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:46.266193 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:46.266208 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:46.266240 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:46.268818 (+ 2578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:46.269414 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:46.269420 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:46.269423 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:46.269535 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:46.269828 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:46.269830 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:46.269832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:46.270161 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:46.270439 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:46.270673 (+ 234us) server_negotiation.cc:299] Negotiation successful
0806 10:40:46.270863 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":412,"threads_started":1}
I20260806 10:40:46.272521 17114 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:40:46.354467 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 16929
I20260806 10:40:46.373083 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 17130
Aug 06 10:40:46 dist-test-slave-fgb3 krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:40:46.388958 17365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:46.374182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45068 (local address 127.16.45.67:43135)
0806 10:40:46.374919 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:46.374927 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:46.374956 (+ 29us) server_negotiation.cc:407] Connection header received
0806 10:40:46.375022 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:46.375028 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:46.375228 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:46.375354 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:46.376539 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:46.377562 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:46.378884 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:46.379612 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:46.379715 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:46.383647 (+ 3932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:46.383658 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:46.383672 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:46.383709 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:46.386282 (+ 2573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:46.386908 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:46.386916 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:46.386918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:46.387044 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:46.387392 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:46.387396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:46.387398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:46.387736 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:46.388030 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:46.388345 (+ 315us) server_negotiation.cc:299] Negotiation successful
0806 10:40:46.388638 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":417,"threads_started":1}
I20260806 10:40:46.390208 17331 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:40:46.471710 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 17130
I20260806 10:40:46.490021 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16592
I20260806 10:40:46.491180 16681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:40:46.593917 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 16592
2026-08-06T10:40:46Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (5659 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:40:46 dist-test-slave-fgb3 krb5kdc[17373](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:40:46 dist-test-slave-fgb3 krb5kdc[17373](info): set up 2 sockets
Aug 06 10:40:46 dist-test-slave-fgb3 krb5kdc[17373](info): commencing operation
krb5kdc: starting...
W20260806 10:40:47.764290 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.001s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:40:47 dist-test-slave-fgb3 krb5kdc[17373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:40:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:40:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:40:47.950585 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:39387
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:42603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:39387
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:48.284765 17393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:48.285094 17393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:48.285236 17393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:48.292659 17393 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:40:48.292798 17393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:48.292879 17393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:48.292961 17393 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:40:48.293020 17393 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:40:48.303192 17393 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:39387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:39387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:48.304605 17393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:48.305965 17393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:48.317647 17400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:48.317672 17399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:48.317698 17402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:48.319310 17393 server_base.cc:1034] running on GCE node
I20260806 10:40:48.320163 17393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:48.321658 17393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:48.322863 17393 hybrid_clock.cc:648] HybridClock initialized: now 1786012848322823 us; error 28 us; skew 500 ppm
I20260806 10:40:48.323199 17393 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:48 dist-test-slave-fgb3 krb5kdc[17373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012848, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:48.326201 17393 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:40:48.327781 17393 webserver.cc:460] Webserver started at http://127.16.45.126:38717/ using document root <none> and password file <none>
I20260806 10:40:48.328444 17393 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:48.328558 17393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:48.328859 17393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:48.331833 17393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "5bdc3b1c6d6842e7a948112ce77241ca"
format_stamp: "Formatted at 2026-08-06 10:40:48 on dist-test-slave-fgb3"
server_key: "dee3160ce6539a47b697a75de21265ed"
server_key_iv: "2ec429b9310ccc4edb0c26078beab9c6"
server_key_version: "encryptionkey@0"
I20260806 10:40:48.332556 17393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "5bdc3b1c6d6842e7a948112ce77241ca"
format_stamp: "Formatted at 2026-08-06 10:40:48 on dist-test-slave-fgb3"
server_key: "dee3160ce6539a47b697a75de21265ed"
server_key_iv: "2ec429b9310ccc4edb0c26078beab9c6"
server_key_version: "encryptionkey@0"
I20260806 10:40:48.337574 17393 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:40:48.341221 17413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:48.342636 17393 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 10:40:48.342803 17393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "5bdc3b1c6d6842e7a948112ce77241ca"
format_stamp: "Formatted at 2026-08-06 10:40:48 on dist-test-slave-fgb3"
server_key: "dee3160ce6539a47b697a75de21265ed"
server_key_iv: "2ec429b9310ccc4edb0c26078beab9c6"
server_key_version: "encryptionkey@0"
I20260806 10:40:48.342985 17393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:48.361639 17393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:48.365857 17393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:48.366129 17393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:48.382936 17393 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:39387
I20260806 10:40:48.382985 17486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:39387 every 8 connection(s)
I20260806 10:40:48.384271 17393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:40:48.388273 17488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:48.388954 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 17393
I20260806 10:40:48.389209 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:40:48.390105 16565 external_mini_cluster.cc:1428] Setting key f4c93c26cc79b06d9cbd8d77c8384fc7
I20260806 10:40:48.402694 17488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca: Bootstrap starting.
Aug 06 10:40:48 dist-test-slave-fgb3 krb5kdc[17373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:48.406407 17488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:48.407428 17488 log.cc:824] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:48.410717 17488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca: No bootstrap required, opened a new log
I20260806 10:40:48.413549 17494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:48.392328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49116 (local address 127.16.45.126:39387)
0806 10:40:48.393060 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:48.393071 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:48.393113 (+ 42us) server_negotiation.cc:407] Connection header received
0806 10:40:48.394994 (+ 1881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:48.395022 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:48.395416 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:48.395742 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:48.397511 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:48.398838 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:48.400563 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:48.401187 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:48.401308 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:48.405962 (+ 4654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:48.405971 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:48.405986 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:48.406032 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:48.409366 (+ 3334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:48.410210 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:48.410218 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:48.410226 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:48.410453 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:48.410863 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:48.410868 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:48.410871 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:48.411419 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:48.411630 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:48.412159 (+ 529us) server_negotiation.cc:299] Negotiation successful
0806 10:40:48.412507 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":336,"threads_started":1}
I20260806 10:40:48.418426 17488 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bdc3b1c6d6842e7a948112ce77241ca" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39387 } }
I20260806 10:40:48.418780 17488 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:48.418877 17488 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bdc3b1c6d6842e7a948112ce77241ca, State: Initialized, Role: FOLLOWER
I20260806 10:40:48.419476 17488 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bdc3b1c6d6842e7a948112ce77241ca" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39387 } }
I20260806 10:40:48.419690 17488 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:40:48.419811 17488 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:40:48.419955 17488 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:48.422043 17488 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bdc3b1c6d6842e7a948112ce77241ca" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39387 } }
I20260806 10:40:48.422665 17488 leader_election.cc:302] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5bdc3b1c6d6842e7a948112ce77241ca; no voters:
I20260806 10:40:48.423235 17488 leader_election.cc:288] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:40:48.423363 17496 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:40:48.424346 17496 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [term 1 LEADER]: Becoming Leader. State: Replica: 5bdc3b1c6d6842e7a948112ce77241ca, State: Running, Role: LEADER
I20260806 10:40:48.424904 17496 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bdc3b1c6d6842e7a948112ce77241ca" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39387 } }
I20260806 10:40:48.425391 17488 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:40:48.427670 17497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5bdc3b1c6d6842e7a948112ce77241ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bdc3b1c6d6842e7a948112ce77241ca" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39387 } } }
I20260806 10:40:48.428189 17497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [sys.catalog]: This master's current role is: LEADER
I20260806 10:40:48.428627 17498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5bdc3b1c6d6842e7a948112ce77241ca. Latest consensus state: current_term: 1 leader_uuid: "5bdc3b1c6d6842e7a948112ce77241ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bdc3b1c6d6842e7a948112ce77241ca" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39387 } } }
I20260806 10:40:48.428957 17498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca [sys.catalog]: This master's current role is: LEADER
I20260806 10:40:48.430881 17503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:40:48.436101 17503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:40:48.445437 17503 catalog_manager.cc:1347] Generated new cluster ID: 3395a352c1bf4a808e1c9e956284f0f8
I20260806 10:40:48.445571 17503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:40:48.461781 17503 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:40:48.463200 17503 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:40:48.477032 17503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5bdc3b1c6d6842e7a948112ce77241ca: Generated new TSK 0
I20260806 10:40:48.478019 17503 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:40:48.530646 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:39387
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:42603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:48.849926 17526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:48.850203 17526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:48.850370 17526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:48.857577 17526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:48.857694 17526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:48.857846 17526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:40:48.867877 17526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:39387
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:48.869205 17526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:48.870626 17526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:48.883771 17533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:48.883783 17536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:48.884313 17532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:48.884430 17526 server_base.cc:1034] running on GCE node
I20260806 10:40:48.885079 17526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:48.886019 17526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:48.887228 17526 hybrid_clock.cc:648] HybridClock initialized: now 1786012848887176 us; error 38 us; skew 500 ppm
I20260806 10:40:48.887574 17526 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:48 dist-test-slave-fgb3 krb5kdc[17373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012848, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:48.890816 17526 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:40:48.892365 17526 webserver.cc:460] Webserver started at http://127.16.45.65:34411/ using document root <none> and password file <none>
I20260806 10:40:48.893091 17526 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:48.893204 17526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:48.893533 17526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:48.896569 17526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "a8ad0eb7e14a4abe8a457788d94b3875"
format_stamp: "Formatted at 2026-08-06 10:40:48 on dist-test-slave-fgb3"
server_key: "663fa1e5ccc2610111964bae3c5ca7a1"
server_key_iv: "1205872ffacf021773d0eea59d684314"
server_key_version: "encryptionkey@0"
I20260806 10:40:48.897349 17526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "a8ad0eb7e14a4abe8a457788d94b3875"
format_stamp: "Formatted at 2026-08-06 10:40:48 on dist-test-slave-fgb3"
server_key: "663fa1e5ccc2610111964bae3c5ca7a1"
server_key_iv: "1205872ffacf021773d0eea59d684314"
server_key_version: "encryptionkey@0"
I20260806 10:40:48.902472 17526 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 10:40:48.905854 17543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:48.907145 17526 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:40:48.907305 17526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "a8ad0eb7e14a4abe8a457788d94b3875"
format_stamp: "Formatted at 2026-08-06 10:40:48 on dist-test-slave-fgb3"
server_key: "663fa1e5ccc2610111964bae3c5ca7a1"
server_key_iv: "1205872ffacf021773d0eea59d684314"
server_key_version: "encryptionkey@0"
I20260806 10:40:48.907500 17526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:48.921346 17526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:48.925799 17526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:48.926079 17526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:48.927173 17526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:40:48.928524 17526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:40:48.928601 17526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:48.928715 17526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:40:48.928771 17526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:48.960201 17526 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:37419
I20260806 10:40:48.960245 17708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:37419 every 8 connection(s)
I20260806 10:40:48.961426 17526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:40:48.968931 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 17526
I20260806 10:40:48.969139 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:40:48.969887 16565 external_mini_cluster.cc:1428] Setting key 4c158bcfe6e84b2b3bbc618416768d8b
Aug 06 10:40:48 dist-test-slave-fgb3 krb5kdc[17373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012848, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:48.982681 17713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:48.963996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:50735 (local address 127.16.45.126:39387)
0806 10:40:48.964430 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:48.964441 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:48.965366 (+ 925us) server_negotiation.cc:407] Connection header received
0806 10:40:48.967215 (+ 1849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:48.967221 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:48.967299 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:48.967393 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:48.968846 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:48.969813 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:48.972089 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:48.972703 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:48.972805 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:48.976742 (+ 3937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:48.976748 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:48.976751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:48.976783 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:48.979694 (+ 2911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:48.980396 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:48.980402 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:48.980406 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:48.980529 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:48.980943 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:48.980949 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:48.980952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:48.981224 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:48.981368 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:48.982055 (+ 687us) server_negotiation.cc:299] Negotiation successful
0806 10:40:48.982285 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":219,"threads_started":1}
I20260806 10:40:48.983716 17715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:48.964523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:39387 (local address 127.16.45.65:50735)
0806 10:40:48.965201 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:48.965245 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:48.966965 (+ 1720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:48.967628 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:48.967637 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:48.968137 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:48.968683 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:48.968699 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:48.969998 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:48.970004 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:48.971797 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:48.971809 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:48.972924 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:48.972932 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:48.973212 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:48.973878 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:48.973909 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:48.976526 (+ 2617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:48.979831 (+ 3305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:48.979847 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:48.979860 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:48.980263 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:48.980632 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:48.980635 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:48.980637 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:48.980818 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:48.981349 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:48.981358 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:48.981681 (+ 323us) client_negotiation.cc:769] Sending connection context
0806 10:40:48.981921 (+ 240us) client_negotiation.cc:240] Negotiation successful
0806 10:40:48.982485 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":265,"threads_started":1}
I20260806 10:40:48.985263 17709 heartbeater.cc:347] Connected to a master server at 127.16.45.126:39387
I20260806 10:40:48.985621 17709 heartbeater.cc:464] Registering TS with master...
I20260806 10:40:48.986557 17709 heartbeater.cc:511] Master 127.16.45.126:39387 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
I20260806 10:40:48.988973 17440 ts_manager.cc:194] Registered new tserver with Master: a8ad0eb7e14a4abe8a457788d94b3875 (127.16.45.65:37419)
I20260806 10:40:48.990458 17440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:50735
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:40:49.014379 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:39387
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:42603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:49.332973 17718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:49.333251 17718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:49.333353 17718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:49.340696 17718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:49.340832 17718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:49.340955 17718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:40:49.351249 17718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:39387
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:49.352523 17718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:49.353853 17718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:49.366969 17726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:49.366930 17728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:49.367009 17730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:49.368037 17718 server_base.cc:1034] running on GCE node
I20260806 10:40:49.368687 17718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:49.369637 17718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:49.370844 17718 hybrid_clock.cc:648] HybridClock initialized: now 1786012849370782 us; error 52 us; skew 500 ppm
I20260806 10:40:49.371186 17718 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:49 dist-test-slave-fgb3 krb5kdc[17373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012849, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:49.374337 17718 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:40:49.375736 17718 webserver.cc:460] Webserver started at http://127.16.45.66:39727/ using document root <none> and password file <none>
I20260806 10:40:49.376395 17718 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:49.376511 17718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:49.376804 17718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:49.379738 17718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "609f250613254d169407b6cfb81d3753"
format_stamp: "Formatted at 2026-08-06 10:40:49 on dist-test-slave-fgb3"
server_key: "dc62f261980c3322b5b30046512ac7cd"
server_key_iv: "44e1b7250005775f8dfa36bcb5ed8fdc"
server_key_version: "encryptionkey@0"
I20260806 10:40:49.380513 17718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "609f250613254d169407b6cfb81d3753"
format_stamp: "Formatted at 2026-08-06 10:40:49 on dist-test-slave-fgb3"
server_key: "dc62f261980c3322b5b30046512ac7cd"
server_key_iv: "44e1b7250005775f8dfa36bcb5ed8fdc"
server_key_version: "encryptionkey@0"
I20260806 10:40:49.385816 17718 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260806 10:40:49.389539 17743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:49.391000 17718 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:40:49.391155 17718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "609f250613254d169407b6cfb81d3753"
format_stamp: "Formatted at 2026-08-06 10:40:49 on dist-test-slave-fgb3"
server_key: "dc62f261980c3322b5b30046512ac7cd"
server_key_iv: "44e1b7250005775f8dfa36bcb5ed8fdc"
server_key_version: "encryptionkey@0"
I20260806 10:40:49.391343 17718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:49.429965 17718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:49.434494 17718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:49.434779 17718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:49.435817 17718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:40:49.437216 17718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:40:49.437296 17718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:49.437417 17718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:40:49.437485 17718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:49.468552 17718 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:43721
I20260806 10:40:49.468621 17922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:43721 every 8 connection(s)
I20260806 10:40:49.469875 17718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:40:49.473755 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 17718
I20260806 10:40:49.473970 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:40:49.474445 16565 external_mini_cluster.cc:1428] Setting key f648d84bb22619089f992a6c7b00ede7
Aug 06 10:40:49 dist-test-slave-fgb3 krb5kdc[17373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012849, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:49.489856 17713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:49.472460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:47967 (local address 127.16.45.126:39387)
0806 10:40:49.472656 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:49.472661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:49.473743 (+ 1082us) server_negotiation.cc:407] Connection header received
0806 10:40:49.475707 (+ 1964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:49.475713 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:49.475795 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:49.475882 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:49.477546 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:49.478266 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:49.479799 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:49.480189 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:49.480298 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:49.483593 (+ 3295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:49.483598 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:49.483601 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:49.483632 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:49.486811 (+ 3179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:49.487542 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:49.487547 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:49.487550 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:49.487711 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:49.488118 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:49.488122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:49.488124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:49.488426 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:49.488578 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:49.489264 (+ 686us) server_negotiation.cc:299] Negotiation successful
0806 10:40:49.489514 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:40:49.490948 17928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:49.472894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:39387 (local address 127.16.45.66:47967)
0806 10:40:49.473582 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:49.473624 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:49.475452 (+ 1828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:49.476130 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:49.476139 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:49.476634 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:49.477383 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:49.477404 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:49.478431 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:49.478436 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:49.479662 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:49.479674 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:49.480405 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:49.480413 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:49.480624 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:49.481261 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:49.481282 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:49.483387 (+ 2105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:49.486953 (+ 3566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:49.486961 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:49.486975 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:49.487426 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:49.487804 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:49.487807 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:49.487810 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:49.488008 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:49.488560 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:49.488568 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:49.488912 (+ 344us) client_negotiation.cc:769] Sending connection context
0806 10:40:49.489156 (+ 244us) client_negotiation.cc:240] Negotiation successful
0806 10:40:49.489764 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":285,"threads_started":1}
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
I20260806 10:40:49.492309 17924 heartbeater.cc:347] Connected to a master server at 127.16.45.126:39387
I20260806 10:40:49.492609 17924 heartbeater.cc:464] Registering TS with master...
I20260806 10:40:49.493445 17924 heartbeater.cc:511] Master 127.16.45.126:39387 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
I20260806 10:40:49.494978 17440 ts_manager.cc:194] Registered new tserver with Master: 609f250613254d169407b6cfb81d3753 (127.16.45.66:43721)
I20260806 10:40:49.495815 17440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:47967
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:40:49.517112 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:39387
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:42603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:49.846632 17931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:49.846948 17931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:49.847097 17931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:49.854386 17931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:49.854491 17931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:49.854645 17931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:40:49.864753 17931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:39387
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:49.866083 17931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:49.867470 17931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:49.880115 17938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:49.880133 17941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:49.880299 17937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:49.880872 17931 server_base.cc:1034] running on GCE node
I20260806 10:40:49.881422 17931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:49.882274 17931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:49.883524 17931 hybrid_clock.cc:648] HybridClock initialized: now 1786012849883472 us; error 39 us; skew 500 ppm
I20260806 10:40:49.883826 17931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:49 dist-test-slave-fgb3 krb5kdc[17373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012849, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:49.886865 17931 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:40:49.888226 17931 webserver.cc:460] Webserver started at http://127.16.45.67:34987/ using document root <none> and password file <none>
I20260806 10:40:49.888994 17931 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:49.889099 17931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:49.889354 17931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:49.892391 17931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "6a36cd5048b14e29bcb6802b8f93be41"
format_stamp: "Formatted at 2026-08-06 10:40:49 on dist-test-slave-fgb3"
server_key: "603cf36ecb8d59f823e53957a03305fe"
server_key_iv: "89882fbe215d288648a0d732944a3660"
server_key_version: "encryptionkey@0"
I20260806 10:40:49.893149 17931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "6a36cd5048b14e29bcb6802b8f93be41"
format_stamp: "Formatted at 2026-08-06 10:40:49 on dist-test-slave-fgb3"
server_key: "603cf36ecb8d59f823e53957a03305fe"
server_key_iv: "89882fbe215d288648a0d732944a3660"
server_key_version: "encryptionkey@0"
I20260806 10:40:49.898660 17931 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 10:40:49.902559 17951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:49.903975 17931 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:40:49.904148 17931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "6a36cd5048b14e29bcb6802b8f93be41"
format_stamp: "Formatted at 2026-08-06 10:40:49 on dist-test-slave-fgb3"
server_key: "603cf36ecb8d59f823e53957a03305fe"
server_key_iv: "89882fbe215d288648a0d732944a3660"
server_key_version: "encryptionkey@0"
I20260806 10:40:49.904362 17931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:49.922775 17931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:49.927858 17931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:49.928169 17931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:49.929251 17931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:40:49.930855 17931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:40:49.930946 17931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:49.931087 17931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:40:49.931154 17931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:49.967202 17931 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:35667
I20260806 10:40:49.967269 18125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:35667 every 8 connection(s)
I20260806 10:40:49.968628 17931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:40:49.978418 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 17931
I20260806 10:40:49.978619 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:40:49.979040 16565 external_mini_cluster.cc:1428] Setting key 4a16d944e1a773d209cf137d8a192fd4
Aug 06 10:40:49 dist-test-slave-fgb3 krb5kdc[17373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012849, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:49.988286 17713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:49.971201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:37437 (local address 127.16.45.126:39387)
0806 10:40:49.971443 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:49.971447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:49.972528 (+ 1081us) server_negotiation.cc:407] Connection header received
0806 10:40:49.974885 (+ 2357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:49.974891 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:49.974995 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:49.975089 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:49.976741 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:49.977510 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:49.979202 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:49.979641 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:49.979754 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:49.983105 (+ 3351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:49.983110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:49.983113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:49.983145 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:49.985404 (+ 2259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:49.986089 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:49.986093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:49.986095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:49.986221 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:49.986652 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:49.986655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:49.986657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:49.986926 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:49.987057 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:49.987729 (+ 672us) server_negotiation.cc:299] Negotiation successful
0806 10:40:49.987957 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260806 10:40:49.989240 18128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:49.971678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:39387 (local address 127.16.45.67:37437)
0806 10:40:49.972386 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:49.972422 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:49.974551 (+ 2129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:49.975368 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:49.975376 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:49.975944 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:49.976576 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:49.976593 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:49.977663 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:49.977669 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:49.979073 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:49.979089 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:49.979865 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:49.979874 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:49.980138 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:49.980759 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:49.980786 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:49.982897 (+ 2111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:49.985536 (+ 2639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:49.985545 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:49.985561 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:49.985969 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:49.986346 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:49.986351 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:49.986354 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:49.986539 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:49.987048 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:49.987056 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:49.987384 (+ 328us) client_negotiation.cc:769] Sending connection context
0806 10:40:49.987619 (+ 235us) client_negotiation.cc:240] Negotiation successful
0806 10:40:49.988159 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":297,"threads_started":1}
I20260806 10:40:49.990679 18126 heartbeater.cc:347] Connected to a master server at 127.16.45.126:39387
I20260806 10:40:49.990932 18126 heartbeater.cc:464] Registering TS with master...
I20260806 10:40:49.991596 18126 heartbeater.cc:511] Master 127.16.45.126:39387 requested a full tablet report, sending...
I20260806 10:40:49.993192 17439 ts_manager.cc:194] Registered new tserver with Master: 6a36cd5048b14e29bcb6802b8f93be41 (127.16.45.67:35667)
I20260806 10:40:49.993433 17709 heartbeater.cc:503] Master 127.16.45.126:39387 was elected leader, sending a full tablet report...
I20260806 10:40:49.994287 17439 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:37437
I20260806 10:40:49.995194 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:40:50.016516 17713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.003153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49128 (local address 127.16.45.126:39387)
0806 10:40:50.003366 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:50.003371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:50.003833 (+ 462us) server_negotiation.cc:407] Connection header received
0806 10:40:50.003955 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:50.003964 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:50.004033 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:50.004126 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:50.005764 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.006720 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.008006 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.008478 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.008576 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.010983 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:50.010989 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:50.010993 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:50.011029 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:50.013763 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.014426 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.014432 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.014435 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.014588 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.014954 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.014958 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.014960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.015293 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:50.015521 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:50.015874 (+ 353us) server_negotiation.cc:299] Negotiation successful
0806 10:40:50.016100 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 10:40:50.025890 17439 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:40:50.035713 17439 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:40:50.075941 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.053891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:43721 (local address 127.0.0.1:35710)
0806 10:40:50.065284 (+ 11393us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:50.065369 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:50.065641 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:50.066635 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:50.066643 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:50.066676 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:50.067207 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:50.067223 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.069542 (+ 2319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.069548 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:50.072475 (+ 2927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:50.072491 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.074753 (+ 2262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.074770 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:50.074986 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.075044 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 10:40:50.075206 (+ 162us) client_negotiation.cc:240] Negotiation successful
0806 10:40:50.075402 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11024,"mutex_wait_us":1,"thread_start_us":10807,"threads_started":1}
I20260806 10:40:50.076839 18145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.053948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35710 (local address 127.16.45.66:43721)
0806 10:40:50.064392 (+ 10444us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:50.064405 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:50.065898 (+ 1493us) server_negotiation.cc:407] Connection header received
0806 10:40:50.066017 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:50.066025 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:50.066366 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:50.067421 (+ 1055us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:50.067740 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.069368 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.072753 (+ 3385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.074515 (+ 1762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.074663 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.074886 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:50.076214 (+ 1328us) server_negotiation.cc:299] Negotiation successful
0806 10:40:50.076445 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10210,"thread_start_us":10029,"threads_started":1}
I20260806 10:40:50.078310 18143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.053941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:35667 (local address 127.0.0.1:45384)
0806 10:40:50.066235 (+ 12294us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:50.066257 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:50.066457 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:50.068078 (+ 1621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:50.068083 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:50.068110 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:50.068642 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:50.068656 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.071033 (+ 2377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.071039 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:50.073811 (+ 2772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:50.073826 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.077367 (+ 3541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.077374 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:50.077537 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.077568 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 10:40:50.077645 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 10:40:50.077779 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12156,"mutex_wait_us":1,"thread_start_us":11919,"threads_started":1}
I20260806 10:40:50.079671 18146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.054240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45384 (local address 127.16.45.67:35667)
0806 10:40:50.067362 (+ 13122us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:50.067371 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:50.067408 (+ 37us) server_negotiation.cc:407] Connection header received
0806 10:40:50.067568 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:50.067577 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:50.067816 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:50.068859 (+ 1043us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:50.069118 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.070872 (+ 1754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.074012 (+ 3140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.076933 (+ 2921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.078685 (+ 1752us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.078957 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:50.079035 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 10:40:50.079222 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12904,"thread_start_us":12727,"threads_started":1}
I20260806 10:40:50.080406 18149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.067516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:37419 (local address 127.0.0.1:42640)
0806 10:40:50.072250 (+ 4734us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:50.072270 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:50.072394 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:50.073082 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:50.073086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:50.073110 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:50.073828 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:50.073839 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.075977 (+ 2138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.075983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:50.077856 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:50.077868 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.079473 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.079479 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:50.079713 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.079747 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 10:40:50.079833 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 10:40:50.079971 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4260,"thread_start_us":3968,"threads_started":1}
I20260806 10:40:50.081274 18147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.066609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42640 (local address 127.16.45.65:37419)
0806 10:40:50.071289 (+ 4680us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:50.071298 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:50.072529 (+ 1231us) server_negotiation.cc:407] Connection header received
0806 10:40:50.072650 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:50.072658 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:50.072885 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:50.073067 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:50.074168 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.075838 (+ 1670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.078019 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.079268 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.079395 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.079677 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:50.079958 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 10:40:50.080937 (+ 979us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4516,"thread_start_us":4293,"threads_started":1}
I20260806 10:40:50.081959 17816 tablet_service.cc:1467] Processing CreateTablet for tablet a89282eda54b466ba3dd20c68e421ad3 (DEFAULT_TABLE table=test-table [id=f9a57d83be974f3bab8c8f8e2cbde9e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:40:50.083614 17816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a89282eda54b466ba3dd20c68e421ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:50.083745 18022 tablet_service.cc:1467] Processing CreateTablet for tablet a89282eda54b466ba3dd20c68e421ad3 (DEFAULT_TABLE table=test-table [id=f9a57d83be974f3bab8c8f8e2cbde9e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:40:50.084761 17608 tablet_service.cc:1467] Processing CreateTablet for tablet a89282eda54b466ba3dd20c68e421ad3 (DEFAULT_TABLE table=test-table [id=f9a57d83be974f3bab8c8f8e2cbde9e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:40:50.085534 18022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a89282eda54b466ba3dd20c68e421ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:50.086428 17608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a89282eda54b466ba3dd20c68e421ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:50.097327 18150 tablet_bootstrap.cc:492] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753: Bootstrap starting.
I20260806 10:40:50.101668 18150 tablet_bootstrap.cc:654] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:50.102254 18151 tablet_bootstrap.cc:492] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41: Bootstrap starting.
I20260806 10:40:50.103498 18150 log.cc:824] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:50.105180 18155 tablet_bootstrap.cc:492] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875: Bootstrap starting.
I20260806 10:40:50.106909 18151 tablet_bootstrap.cc:654] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:50.107434 18150 tablet_bootstrap.cc:492] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753: No bootstrap required, opened a new log
I20260806 10:40:50.107832 18150 ts_tablet_manager.cc:1397] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260806 10:40:50.108718 18151 log.cc:824] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:50.110517 18155 tablet_bootstrap.cc:654] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:50.111815 18155 log.cc:824] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:50.114933 18155 tablet_bootstrap.cc:492] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875: No bootstrap required, opened a new log
I20260806 10:40:50.115312 18155 ts_tablet_manager.cc:1397] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20260806 10:40:50.117241 18151 tablet_bootstrap.cc:492] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41: No bootstrap required, opened a new log
I20260806 10:40:50.117580 18151 ts_tablet_manager.cc:1397] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20260806 10:40:50.121127 18150 raft_consensus.cc:348] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "609f250613254d169407b6cfb81d3753" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43721 } } peers { permanent_uuid: "6a36cd5048b14e29bcb6802b8f93be41" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35667 } } peers { permanent_uuid: "a8ad0eb7e14a4abe8a457788d94b3875" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37419 } }
I20260806 10:40:50.121742 18150 raft_consensus.cc:374] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:50.121948 18150 raft_consensus.cc:729] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 609f250613254d169407b6cfb81d3753, State: Initialized, Role: FOLLOWER
I20260806 10:40:50.122704 18150 consensus_queue.cc:260] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "609f250613254d169407b6cfb81d3753" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43721 } } peers { permanent_uuid: "6a36cd5048b14e29bcb6802b8f93be41" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35667 } } peers { permanent_uuid: "a8ad0eb7e14a4abe8a457788d94b3875" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37419 } }
I20260806 10:40:50.123919 17924 heartbeater.cc:503] Master 127.16.45.126:39387 was elected leader, sending a full tablet report...
I20260806 10:40:50.124009 18155 raft_consensus.cc:348] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "609f250613254d169407b6cfb81d3753" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43721 } } peers { permanent_uuid: "6a36cd5048b14e29bcb6802b8f93be41" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35667 } } peers { permanent_uuid: "a8ad0eb7e14a4abe8a457788d94b3875" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37419 } }
I20260806 10:40:50.124368 18155 raft_consensus.cc:374] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:50.124462 18155 raft_consensus.cc:729] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ad0eb7e14a4abe8a457788d94b3875, State: Initialized, Role: FOLLOWER
I20260806 10:40:50.124696 18150 ts_tablet_manager.cc:1428] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
I20260806 10:40:50.125029 18155 consensus_queue.cc:260] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "609f250613254d169407b6cfb81d3753" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43721 } } peers { permanent_uuid: "6a36cd5048b14e29bcb6802b8f93be41" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35667 } } peers { permanent_uuid: "a8ad0eb7e14a4abe8a457788d94b3875" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37419 } }
I20260806 10:40:50.127887 18155 ts_tablet_manager.cc:1428] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260806 10:40:50.130623 18151 raft_consensus.cc:348] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "609f250613254d169407b6cfb81d3753" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43721 } } peers { permanent_uuid: "6a36cd5048b14e29bcb6802b8f93be41" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35667 } } peers { permanent_uuid: "a8ad0eb7e14a4abe8a457788d94b3875" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37419 } }
I20260806 10:40:50.131098 18151 raft_consensus.cc:374] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:50.131206 18151 raft_consensus.cc:729] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a36cd5048b14e29bcb6802b8f93be41, State: Initialized, Role: FOLLOWER
I20260806 10:40:50.131939 18151 consensus_queue.cc:260] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "609f250613254d169407b6cfb81d3753" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43721 } } peers { permanent_uuid: "6a36cd5048b14e29bcb6802b8f93be41" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35667 } } peers { permanent_uuid: "a8ad0eb7e14a4abe8a457788d94b3875" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37419 } }
I20260806 10:40:50.133476 18126 heartbeater.cc:503] Master 127.16.45.126:39387 was elected leader, sending a full tablet report...
I20260806 10:40:50.134300 18151 ts_tablet_manager.cc:1428] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
W20260806 10:40:50.213865 17710 tablet.cc:2369] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:40:50.220378 18127 tablet.cc:2369] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:40:50.221880 17925 tablet.cc:2369] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:40:50.420529 18162 raft_consensus.cc:482] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:40:50.420993 18162 raft_consensus.cc:504] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "609f250613254d169407b6cfb81d3753" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43721 } } peers { permanent_uuid: "6a36cd5048b14e29bcb6802b8f93be41" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35667 } } peers { permanent_uuid: "a8ad0eb7e14a4abe8a457788d94b3875" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37419 } }
I20260806 10:40:50.423990 18162 leader_election.cc:288] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a36cd5048b14e29bcb6802b8f93be41 (127.16.45.67:35667), a8ad0eb7e14a4abe8a457788d94b3875 (127.16.45.65:37419)
I20260806 10:40:50.431619 18147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.425827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:59153 (local address 127.16.45.65:37419)
0806 10:40:50.426036 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:50.426042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:50.426291 (+ 249us) server_negotiation.cc:407] Connection header received
0806 10:40:50.426499 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:50.426503 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:50.426591 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:50.426675 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:50.427268 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.427961 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.429753 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.430639 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.430796 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.430873 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:50.431241 (+ 368us) server_negotiation.cc:299] Negotiation successful
0806 10:40:50.431366 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 10:40:50.431895 18146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.424390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:41585 (local address 127.16.45.67:35667)
0806 10:40:50.424587 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:50.424592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:50.425478 (+ 886us) server_negotiation.cc:407] Connection header received
0806 10:40:50.425722 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:50.425729 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:50.425835 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:50.425938 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:50.426869 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.427760 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.429811 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.430733 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.430941 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.431018 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:50.431512 (+ 494us) server_negotiation.cc:299] Negotiation successful
0806 10:40:50.431645 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 10:40:50.431958 18168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.425511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:37419 (local address 127.16.45.66:59153)
0806 10:40:50.426195 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:50.426208 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:50.426364 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:50.426700 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:50.426705 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:50.426729 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:50.427122 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:50.427133 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.428098 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.428103 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:50.429592 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:50.429605 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.430912 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.430921 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:50.431069 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.431093 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 10:40:50.431192 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 10:40:50.431322 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":3,"thread_start_us":358,"threads_started":1}
I20260806 10:40:50.432451 18167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.424620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:35667 (local address 127.16.45.66:41585)
0806 10:40:50.425327 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:50.425343 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:50.425552 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:50.426147 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:50.426151 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:50.426175 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:50.426720 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:50.426733 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.427889 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.427894 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:50.429653 (+ 1759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:50.429666 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.430980 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.430991 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:50.431335 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.431362 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 10:40:50.431457 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 10:40:50.431583 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"mutex_wait_us":40,"thread_start_us":387,"threads_started":1}
I20260806 10:40:50.433116 17641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a89282eda54b466ba3dd20c68e421ad3" candidate_uuid: "609f250613254d169407b6cfb81d3753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ad0eb7e14a4abe8a457788d94b3875" is_pre_election: true
I20260806 10:40:50.433331 18055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a89282eda54b466ba3dd20c68e421ad3" candidate_uuid: "609f250613254d169407b6cfb81d3753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a36cd5048b14e29bcb6802b8f93be41" is_pre_election: true
I20260806 10:40:50.433851 17641 raft_consensus.cc:2454] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 609f250613254d169407b6cfb81d3753 in term 0.
I20260806 10:40:50.433889 18055 raft_consensus.cc:2454] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 609f250613254d169407b6cfb81d3753 in term 0.
I20260806 10:40:50.436902 17744 leader_election.cc:302] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 609f250613254d169407b6cfb81d3753, a8ad0eb7e14a4abe8a457788d94b3875; no voters:
I20260806 10:40:50.437413 18162 raft_consensus.cc:2781] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:40:50.437743 18162 raft_consensus.cc:482] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:40:50.437872 18162 raft_consensus.cc:3037] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:50.440124 18162 raft_consensus.cc:504] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "609f250613254d169407b6cfb81d3753" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43721 } } peers { permanent_uuid: "6a36cd5048b14e29bcb6802b8f93be41" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35667 } } peers { permanent_uuid: "a8ad0eb7e14a4abe8a457788d94b3875" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37419 } }
I20260806 10:40:50.440714 18162 leader_election.cc:288] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [CANDIDATE]: Term 1 election: Requested vote from peers 6a36cd5048b14e29bcb6802b8f93be41 (127.16.45.67:35667), a8ad0eb7e14a4abe8a457788d94b3875 (127.16.45.65:37419)
I20260806 10:40:50.441262 17641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a89282eda54b466ba3dd20c68e421ad3" candidate_uuid: "609f250613254d169407b6cfb81d3753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ad0eb7e14a4abe8a457788d94b3875"
I20260806 10:40:50.441346 18055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a89282eda54b466ba3dd20c68e421ad3" candidate_uuid: "609f250613254d169407b6cfb81d3753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a36cd5048b14e29bcb6802b8f93be41"
I20260806 10:40:50.441498 17641 raft_consensus.cc:3037] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:50.441583 18055 raft_consensus.cc:3037] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:50.444144 18055 raft_consensus.cc:2454] T a89282eda54b466ba3dd20c68e421ad3 P 6a36cd5048b14e29bcb6802b8f93be41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 609f250613254d169407b6cfb81d3753 in term 1.
I20260806 10:40:50.444167 17641 raft_consensus.cc:2454] T a89282eda54b466ba3dd20c68e421ad3 P a8ad0eb7e14a4abe8a457788d94b3875 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 609f250613254d169407b6cfb81d3753 in term 1.
I20260806 10:40:50.444557 17744 leader_election.cc:302] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 609f250613254d169407b6cfb81d3753, 6a36cd5048b14e29bcb6802b8f93be41; no voters:
I20260806 10:40:50.444823 18162 raft_consensus.cc:2781] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:40:50.445236 18162 raft_consensus.cc:686] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [term 1 LEADER]: Becoming Leader. State: Replica: 609f250613254d169407b6cfb81d3753, State: Running, Role: LEADER
I20260806 10:40:50.445713 18162 consensus_queue.cc:237] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "609f250613254d169407b6cfb81d3753" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43721 } } peers { permanent_uuid: "6a36cd5048b14e29bcb6802b8f93be41" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35667 } } peers { permanent_uuid: "a8ad0eb7e14a4abe8a457788d94b3875" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37419 } }
I20260806 10:40:50.451159 17438 catalog_manager.cc:5495] T a89282eda54b466ba3dd20c68e421ad3 P 609f250613254d169407b6cfb81d3753 reported cstate change: term changed from 0 to 1, leader changed from <none> to 609f250613254d169407b6cfb81d3753 (127.16.45.66). New cstate: current_term: 1 leader_uuid: "609f250613254d169407b6cfb81d3753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "609f250613254d169407b6cfb81d3753" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a36cd5048b14e29bcb6802b8f93be41" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8ad0eb7e14a4abe8a457788d94b3875" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37419 } health_report { overall_health: UNKNOWN } } }
Aug 06 10:40:50 dist-test-slave-fgb3 krb5kdc[17373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:40:50.544906 18147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.528659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42650 (local address 127.16.45.65:37419)
0806 10:40:50.528853 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:50.528859 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:50.529280 (+ 421us) server_negotiation.cc:407] Connection header received
0806 10:40:50.529459 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:50.529464 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:50.529534 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:50.529626 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:50.531283 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.532039 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.533454 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.534085 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.534203 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.538665 (+ 4462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:50.538683 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:50.538699 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:50.538743 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:50.542030 (+ 3287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.542830 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.542838 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.542841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.543067 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.543425 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.543428 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.543430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.543907 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:50.544161 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:50.544371 (+ 210us) server_negotiation.cc:299] Negotiation successful
0806 10:40:50.544539 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 10:40:50 dist-test-slave-fgb3 krb5kdc[17373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012850, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 10:40:50 dist-test-slave-fgb3 krb5kdc[17373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012850, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:40:50.596220 18147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.581887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42652 (local address 127.16.45.65:37419)
0806 10:40:50.582112 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:50.582118 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:50.582408 (+ 290us) server_negotiation.cc:407] Connection header received
0806 10:40:50.582645 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:50.582649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:50.582716 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:50.582794 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:50.584486 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.585200 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.586656 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.587056 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.587150 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.591036 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:50.591041 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:50.591044 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:50.591076 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:50.593796 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.594520 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.594524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.594526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.594657 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.594980 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.594983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.594985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.595261 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:50.595500 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:50.595728 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 10:40:50.595883 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
Aug 06 10:40:50 dist-test-slave-fgb3 krb5kdc[17373](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 10:40:50 dist-test-slave-fgb3 krb5kdc[17373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:40:50.644794 18147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.629682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42658 (local address 127.16.45.65:37419)
0806 10:40:50.629891 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:50.629899 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:50.630253 (+ 354us) server_negotiation.cc:407] Connection header received
0806 10:40:50.630470 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:50.630476 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:50.630544 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:50.630637 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:50.632249 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.632947 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.634341 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.634893 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.635054 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.639473 (+ 4419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:50.639479 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:50.639482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:50.639527 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:50.642208 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.642937 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.642941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.642943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.643111 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.643479 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.643482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.643484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.643751 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:50.643939 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:50.644213 (+ 274us) server_negotiation.cc:299] Negotiation successful
0806 10:40:50.644401 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260806 10:40:50.647060 17581 tablet_service.cc:2908] Rejecting scan request for tablet a89282eda54b466ba3dd20c68e421ad3: Uninitialized: clean time has not yet been initialized
I20260806 10:40:50.650576 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 17526
I20260806 10:40:50.663460 18147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.651328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42672 (local address 127.16.45.65:37419)
0806 10:40:50.651474 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:50.651478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:50.651865 (+ 387us) server_negotiation.cc:407] Connection header received
0806 10:40:50.652034 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:50.652040 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:50.652114 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:50.652192 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:50.653335 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.654026 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.655270 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.655732 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.655878 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.658262 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:50.658267 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:50.658270 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:50.658300 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:50.660734 (+ 2434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.661434 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.661440 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.661443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.661562 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.661928 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.661934 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.661945 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.662208 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:50.662460 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:50.662798 (+ 338us) server_negotiation.cc:299] Negotiation successful
0806 10:40:50.663023 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 10:40:50.664132 17703 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:40:50.752295 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 17526
I20260806 10:40:50.774726 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 17718
Aug 06 10:40:50 dist-test-slave-fgb3 krb5kdc[17373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:40:50.789467 18187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.775477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35726 (local address 127.16.45.66:43721)
0806 10:40:50.775903 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:50.775908 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:50.775925 (+ 17us) server_negotiation.cc:407] Connection header received
0806 10:40:50.775999 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:50.776002 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:50.776062 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:50.776149 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:50.777422 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.778135 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.779495 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.779877 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.779980 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.784169 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:50.784185 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:50.784202 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:50.784241 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:50.786943 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.787656 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.787663 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.787665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.787808 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.788205 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.788208 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.788209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.788539 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:50.788770 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:50.789021 (+ 251us) server_negotiation.cc:299] Negotiation successful
0806 10:40:50.789191 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":222,"threads_started":1}
I20260806 10:40:50.790138 17917 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:40:50.879838 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 17718
I20260806 10:40:50.879920 18167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.879376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:37419 (local address 127.16.45.66:55153)
0806 10:40:50.879551 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:50.879737 (+ 186us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:37419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 10:40:50.902550 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 17931
Aug 06 10:40:50 dist-test-slave-fgb3 krb5kdc[17373](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:40:50.917104 18146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:50.903330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45400 (local address 127.16.45.67:35667)
0806 10:40:50.903519 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:50.903525 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:50.903602 (+ 77us) server_negotiation.cc:407] Connection header received
0806 10:40:50.903803 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:50.903807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:50.903870 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:50.903966 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:50.905163 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.905881 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.907337 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:50.907728 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:50.907834 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:50.911818 (+ 3984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:50.911833 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:50.911849 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:50.911882 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:50.914516 (+ 2634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.915160 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.915167 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.915169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.915297 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:50.915641 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:50.915646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:50.915649 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:50.916014 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:50.916282 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:50.916572 (+ 290us) server_negotiation.cc:299] Negotiation successful
0806 10:40:50.916782 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 10:40:50.917830 18117 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:40:51.005750 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 17931
I20260806 10:40:51.027240 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 17393
I20260806 10:40:51.028497 17478 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:40:51.137617 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 17393
2026-08-06T10:40:51Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4545 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:40:51 dist-test-slave-fgb3 krb5kdc[18198](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:40:51 dist-test-slave-fgb3 krb5kdc[18198](info): set up 2 sockets
Aug 06 10:40:51 dist-test-slave-fgb3 krb5kdc[18198](info): commencing operation
krb5kdc: starting...
W20260806 10:40:52.303539 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:40:52 dist-test-slave-fgb3 krb5kdc[18198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:40:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:40:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:40:52.497795 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:36423
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:33701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:36423
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:52.821017 18225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:52.821338 18225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:52.821504 18225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:52.829083 18225 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:40:52.829216 18225 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 10:40:52.829278 18225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:52.829347 18225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:52.829403 18225 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:40:52.829473 18225 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:40:52.839850 18225 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:33701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:36423
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:36423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:52.841111 18225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:52.842501 18225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:52.854436 18232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:52.854362 18239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:52.854411 18233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:52.855322 18225 server_base.cc:1034] running on GCE node
I20260806 10:40:52.856127 18225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:52.857612 18225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:52.858847 18225 hybrid_clock.cc:648] HybridClock initialized: now 1786012852858760 us; error 49 us; skew 500 ppm
I20260806 10:40:52.859165 18225 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:52 dist-test-slave-fgb3 krb5kdc[18198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012852, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:52.862385 18225 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:40:52.863824 18225 webserver.cc:460] Webserver started at http://127.16.45.126:44115/ using document root <none> and password file <none>
I20260806 10:40:52.864542 18225 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:52.864645 18225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:52.864974 18225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:52.867966 18225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "f032be82b24b4815a5d47704c7e6b766"
format_stamp: "Formatted at 2026-08-06 10:40:52 on dist-test-slave-fgb3"
server_key: "65d2b54136145d1d23a0a39f8a0f0bf9"
server_key_iv: "3aefe9cc5d6241d3a524fbaf931a67a8"
server_key_version: "encryptionkey@0"
I20260806 10:40:52.868748 18225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "f032be82b24b4815a5d47704c7e6b766"
format_stamp: "Formatted at 2026-08-06 10:40:52 on dist-test-slave-fgb3"
server_key: "65d2b54136145d1d23a0a39f8a0f0bf9"
server_key_iv: "3aefe9cc5d6241d3a524fbaf931a67a8"
server_key_version: "encryptionkey@0"
I20260806 10:40:52.873907 18225 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 10:40:52.877430 18249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:52.878885 18225 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:40:52.879055 18225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "f032be82b24b4815a5d47704c7e6b766"
format_stamp: "Formatted at 2026-08-06 10:40:52 on dist-test-slave-fgb3"
server_key: "65d2b54136145d1d23a0a39f8a0f0bf9"
server_key_iv: "3aefe9cc5d6241d3a524fbaf931a67a8"
server_key_version: "encryptionkey@0"
I20260806 10:40:52.879292 18225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:52.892082 18225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:52.896343 18225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:52.896587 18225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:52.917188 18225 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:36423
I20260806 10:40:52.917208 18349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:36423 every 8 connection(s)
I20260806 10:40:52.918617 18225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:40:52.922340 18350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:52.927269 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 18225
I20260806 10:40:52.927531 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:40:52.928342 16565 external_mini_cluster.cc:1428] Setting key 4ff89f6b1c3e7737098a89b5a02521d3
I20260806 10:40:52.933454 18350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766: Bootstrap starting.
I20260806 10:40:52.936988 18350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:52.938247 18350 log.cc:824] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:52.941598 18350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766: No bootstrap required, opened a new log
Aug 06 10:40:52 dist-test-slave-fgb3 krb5kdc[18198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:52.950208 18350 raft_consensus.cc:348] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f032be82b24b4815a5d47704c7e6b766" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36423 } }
I20260806 10:40:52.950738 18350 raft_consensus.cc:374] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:52.950848 18350 raft_consensus.cc:729] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f032be82b24b4815a5d47704c7e6b766, State: Initialized, Role: FOLLOWER
I20260806 10:40:52.951443 18350 consensus_queue.cc:260] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f032be82b24b4815a5d47704c7e6b766" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36423 } }
I20260806 10:40:52.951673 18350 raft_consensus.cc:388] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:40:52.951807 18350 raft_consensus.cc:482] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:40:52.951835 18353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:52.930481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50534 (local address 127.16.45.126:36423)
0806 10:40:52.931278 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:52.931289 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:52.931335 (+ 46us) server_negotiation.cc:407] Connection header received
0806 10:40:52.933051 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:52.933078 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:52.933465 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:52.933795 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:52.935551 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:52.936849 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:52.938582 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:52.939619 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:52.939750 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:52.944573 (+ 4823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:52.944581 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:52.944599 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:52.944633 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:52.947667 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:52.948476 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:52.948486 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:52.948491 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:52.948666 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:52.949044 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:52.949047 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:52.949049 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:52.949632 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:52.949846 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:52.950341 (+ 495us) server_negotiation.cc:299] Negotiation successful
0806 10:40:52.950765 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":359,"threads_started":1}
I20260806 10:40:52.951978 18350 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:52.954779 18350 raft_consensus.cc:504] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f032be82b24b4815a5d47704c7e6b766" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36423 } }
I20260806 10:40:52.955241 18350 leader_election.cc:302] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f032be82b24b4815a5d47704c7e6b766; no voters:
I20260806 10:40:52.955792 18350 leader_election.cc:288] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:40:52.955943 18355 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:40:52.956607 18355 raft_consensus.cc:686] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [term 1 LEADER]: Becoming Leader. State: Replica: f032be82b24b4815a5d47704c7e6b766, State: Running, Role: LEADER
I20260806 10:40:52.957119 18355 consensus_queue.cc:237] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f032be82b24b4815a5d47704c7e6b766" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36423 } }
I20260806 10:40:52.957739 18350 sys_catalog.cc:564] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:40:52.960006 18358 sys_catalog.cc:455] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f032be82b24b4815a5d47704c7e6b766. Latest consensus state: current_term: 1 leader_uuid: "f032be82b24b4815a5d47704c7e6b766" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f032be82b24b4815a5d47704c7e6b766" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36423 } } }
I20260806 10:40:52.960536 18358 sys_catalog.cc:458] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [sys.catalog]: This master's current role is: LEADER
I20260806 10:40:52.960027 18356 sys_catalog.cc:455] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f032be82b24b4815a5d47704c7e6b766" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f032be82b24b4815a5d47704c7e6b766" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36423 } } }
I20260806 10:40:52.961054 18356 sys_catalog.cc:458] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766 [sys.catalog]: This master's current role is: LEADER
I20260806 10:40:52.961735 18369 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:40:52.967275 18369 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:40:52.976118 18369 catalog_manager.cc:1347] Generated new cluster ID: 502f69b9786c43359afa8b6b7c7a6c2d
I20260806 10:40:52.976224 18369 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:40:52.993908 18369 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:40:52.995333 18369 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:40:53.003893 18369 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766: Generated new TSK 0
I20260806 10:40:53.004745 18369 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:40:53.057569 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36423
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:33701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:53.405654 18388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:53.405946 18388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:53.406049 18388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:53.413231 18388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:53.413352 18388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:53.413445 18388 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 10:40:53.413528 18388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:40:53.423152 18388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:33701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.45.126:36423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:53.424448 18388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:53.425699 18388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:53.438340 18393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:53.438403 18396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:53.438285 18394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:53.439162 18388 server_base.cc:1034] running on GCE node
I20260806 10:40:53.439779 18388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:53.440706 18388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:53.441932 18388 hybrid_clock.cc:648] HybridClock initialized: now 1786012853441868 us; error 34 us; skew 500 ppm
I20260806 10:40:53.442207 18388 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:53 dist-test-slave-fgb3 krb5kdc[18198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012853, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:53.448221 18388 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:40:53.449688 18388 webserver.cc:460] Webserver started at http://127.16.45.65:33107/ using document root <none> and password file <none>
I20260806 10:40:53.450395 18388 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:53.450491 18388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:53.450764 18388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:53.453617 18388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "9abca473091541928880c3a6324bd067"
format_stamp: "Formatted at 2026-08-06 10:40:53 on dist-test-slave-fgb3"
server_key: "f6d968061546310c2a30a3b5624bcaa7"
server_key_iv: "2ffa587213799dff38242f671fb9d168"
server_key_version: "encryptionkey@0"
I20260806 10:40:53.454427 18388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "9abca473091541928880c3a6324bd067"
format_stamp: "Formatted at 2026-08-06 10:40:53 on dist-test-slave-fgb3"
server_key: "f6d968061546310c2a30a3b5624bcaa7"
server_key_iv: "2ffa587213799dff38242f671fb9d168"
server_key_version: "encryptionkey@0"
I20260806 10:40:53.459304 18388 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 10:40:53.462666 18407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:53.463912 18388 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 10:40:53.464069 18388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "9abca473091541928880c3a6324bd067"
format_stamp: "Formatted at 2026-08-06 10:40:53 on dist-test-slave-fgb3"
server_key: "f6d968061546310c2a30a3b5624bcaa7"
server_key_iv: "2ffa587213799dff38242f671fb9d168"
server_key_version: "encryptionkey@0"
I20260806 10:40:53.464267 18388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:53.475339 18388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:53.479475 18388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:53.479729 18388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:53.482535 18388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:40:53.482640 18388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:53.482851 18388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:40:53.482926 18388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 10:40:53 dist-test-slave-fgb3 krb5kdc[18198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012853, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:53.505002 18419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:53.482867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:49243 (local address 127.16.45.126:36423)
0806 10:40:53.483323 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:53.483331 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:53.484501 (+ 1170us) server_negotiation.cc:407] Connection header received
0806 10:40:53.486470 (+ 1969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:53.486476 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:53.486565 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:53.486660 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:53.488632 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:53.489805 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:53.492287 (+ 2482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:53.492711 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:53.492828 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:53.497575 (+ 4747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:53.497584 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:53.497589 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:53.497639 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:53.501320 (+ 3681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:53.502293 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:53.502299 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:53.502303 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:53.502467 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:53.503038 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:53.503044 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:53.503047 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:53.503406 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:53.503568 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:53.504566 (+ 998us) server_negotiation.cc:299] Negotiation successful
0806 10:40:53.504741 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":290,"threads_started":1}
I20260806 10:40:53.506757 18421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:53.483526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36423 (local address 127.16.45.65:49243)
0806 10:40:53.484353 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:53.484398 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:53.486181 (+ 1783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:53.486900 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:53.486908 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:53.487602 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:53.488378 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:53.488400 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:53.490000 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:53.490006 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:53.492136 (+ 2130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:53.492153 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:53.492972 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:53.492984 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:53.493324 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:53.494117 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:53.494139 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:53.497262 (+ 3123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:53.501491 (+ 4229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:53.501504 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:53.501525 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:53.502157 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:53.502578 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:53.502583 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:53.502585 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:53.502868 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:53.503573 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:53.503584 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:53.504132 (+ 548us) client_negotiation.cc:769] Sending connection context
0806 10:40:53.504465 (+ 333us) client_negotiation.cc:240] Negotiation successful
0806 10:40:53.505096 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":357,"threads_started":1}
I20260806 10:40:53.527470 18517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:53.512520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36423 (local address 127.16.45.65:44007)
0806 10:40:53.513167 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:53.513189 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:53.513344 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:53.513639 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:53.513644 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:53.514280 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:53.514757 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:53.514776 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:53.516031 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:53.516037 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:53.517613 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:53.517626 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:53.518717 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:53.518723 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:53.518922 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:53.519593 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:53.519616 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:53.520742 (+ 1126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:53.523915 (+ 3173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:53.523921 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:53.523925 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:53.524584 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:53.525140 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:53.525149 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:53.525154 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:53.525338 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:53.526096 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:53.526101 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:53.526411 (+ 310us) client_negotiation.cc:769] Sending connection context
0806 10:40:53.526596 (+ 185us) client_negotiation.cc:240] Negotiation successful
0806 10:40:53.527005 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":333,"threads_started":1}
I20260806 10:40:53.528386 18419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:53.512522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:44007 (local address 127.16.45.126:36423)
0806 10:40:53.512713 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:53.512721 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:53.513281 (+ 560us) server_negotiation.cc:407] Connection header received
0806 10:40:53.513454 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:53.513458 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:53.513519 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:53.513594 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:53.514999 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:53.515860 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:53.517807 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:53.518372 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:53.518498 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:53.520934 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:53.520941 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:53.520946 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:53.520988 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:53.523773 (+ 2785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:53.524795 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:53.524801 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:53.524804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:53.524998 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:53.525485 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:53.525490 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:53.525494 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:53.525874 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:53.526025 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:53.527822 (+ 1797us) server_negotiation.cc:299] Negotiation successful
0806 10:40:53.528068 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:40:53.528955 18388 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:38731
I20260806 10:40:53.528987 18591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:38731 every 8 connection(s)
I20260806 10:40:53.530303 18388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:40:53.532555 18593 heartbeater.cc:347] Connected to a master server at 127.16.45.126:36423
I20260806 10:40:53.532760 18593 heartbeater.cc:464] Registering TS with master...
I20260806 10:40:53.533362 18593 heartbeater.cc:511] Master 127.16.45.126:36423 requested a full tablet report, sending...
I20260806 10:40:53.535166 18275 ts_manager.cc:194] Registered new tserver with Master: 9abca473091541928880c3a6324bd067 (127.16.45.65:38731)
I20260806 10:40:53.536545 18275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:49243
I20260806 10:40:53.540021 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 18388
I20260806 10:40:53.540231 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:40:53.540834 16565 external_mini_cluster.cc:1428] Setting key dcf3422c3f6c1b26001a899f4861e08d
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:40:53.581573 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36423
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:33701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:54.013161 18600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:54.013468 18600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:54.013602 18600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:54.020974 18600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:54.021101 18600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:54.021224 18600 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 10:40:54.021385 18600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:40:54.031840 18600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:33701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.45.126:36423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:54.033314 18600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:54.034674 18600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:54.047484 18607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:54.047603 18609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:54.047654 18606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:54.048146 18600 server_base.cc:1034] running on GCE node
I20260806 10:40:54.048724 18600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:54.049610 18600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:54.050844 18600 hybrid_clock.cc:648] HybridClock initialized: now 1786012854050757 us; error 54 us; skew 500 ppm
I20260806 10:40:54.051164 18600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:54 dist-test-slave-fgb3 krb5kdc[18198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012854, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:54.054445 18600 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:40:54.055946 18600 webserver.cc:460] Webserver started at http://127.16.45.66:40779/ using document root <none> and password file <none>
I20260806 10:40:54.056654 18600 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:54.056758 18600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:54.057080 18600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:54.060199 18600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "827850bebdb7400899b3008b3900c170"
format_stamp: "Formatted at 2026-08-06 10:40:54 on dist-test-slave-fgb3"
server_key: "999aababdf26e389079e596caf4269bb"
server_key_iv: "03424b2a8869b25732d1ee5d1b1f4993"
server_key_version: "encryptionkey@0"
I20260806 10:40:54.061062 18600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "827850bebdb7400899b3008b3900c170"
format_stamp: "Formatted at 2026-08-06 10:40:54 on dist-test-slave-fgb3"
server_key: "999aababdf26e389079e596caf4269bb"
server_key_iv: "03424b2a8869b25732d1ee5d1b1f4993"
server_key_version: "encryptionkey@0"
I20260806 10:40:54.066435 18600 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 10:40:54.070001 18624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:54.071364 18600 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:40:54.071528 18600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "827850bebdb7400899b3008b3900c170"
format_stamp: "Formatted at 2026-08-06 10:40:54 on dist-test-slave-fgb3"
server_key: "999aababdf26e389079e596caf4269bb"
server_key_iv: "03424b2a8869b25732d1ee5d1b1f4993"
server_key_version: "encryptionkey@0"
I20260806 10:40:54.071728 18600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:54.093274 18600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:54.097347 18600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:54.097605 18600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:54.100334 18600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:40:54.100425 18600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:54.100590 18600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:40:54.100665 18600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 10:40:54 dist-test-slave-fgb3 krb5kdc[18198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012854, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:54.123515 18639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.100795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:45579 (local address 127.16.45.126:36423)
0806 10:40:54.101515 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:54.101521 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:54.102510 (+ 989us) server_negotiation.cc:407] Connection header received
0806 10:40:54.104462 (+ 1952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:54.104470 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:54.104567 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:54.104688 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:54.106931 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.107876 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.110909 (+ 3033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.111458 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.111588 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.116504 (+ 4916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:54.116510 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:54.116513 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:54.116550 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:54.119393 (+ 2843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:54.120476 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:54.120481 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:54.120484 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:54.120647 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:54.121311 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:54.121315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:54.121317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:54.121672 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:54.121839 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:54.122850 (+ 1011us) server_negotiation.cc:299] Negotiation successful
0806 10:40:54.123097 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":478,"threads_started":1}
I20260806 10:40:54.124542 18640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.101388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36423 (local address 127.16.45.66:45579)
0806 10:40:54.102335 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:54.102382 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:54.104200 (+ 1818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:54.104961 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:54.104971 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:54.105684 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:54.106750 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.106777 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.108251 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.108261 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.110735 (+ 2474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.110753 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.111902 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.111910 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.112223 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.113068 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:54.113114 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:54.116221 (+ 3107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:54.119597 (+ 3376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:54.119610 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:54.119634 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:54.120285 (+ 651us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:54.120804 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:54.120809 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:54.120817 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:54.121155 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:54.121911 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:54.121918 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:54.122361 (+ 443us) client_negotiation.cc:769] Sending connection context
0806 10:40:54.122733 (+ 372us) client_negotiation.cc:240] Negotiation successful
0806 10:40:54.123318 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":359,"threads_started":1}
I20260806 10:40:54.148087 18752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.133339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36423 (local address 127.16.45.66:48217)
0806 10:40:54.134017 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:54.134039 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:54.134208 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:54.134577 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:54.134582 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:54.135290 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:54.135710 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.135725 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.136875 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.136882 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.138835 (+ 1953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.138859 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.139810 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.139823 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.139986 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.140600 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:54.140618 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:54.141723 (+ 1105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:54.145299 (+ 3576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:54.145305 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:54.145309 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:54.145698 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:54.146052 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:54.146057 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:54.146061 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:54.146186 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:54.146944 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:54.146949 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:54.147180 (+ 231us) client_negotiation.cc:769] Sending connection context
0806 10:40:54.147382 (+ 202us) client_negotiation.cc:240] Negotiation successful
0806 10:40:54.147727 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":344,"threads_started":1}
I20260806 10:40:54.148806 18639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.133358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:48217 (local address 127.16.45.126:36423)
0806 10:40:54.133565 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:54.133572 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:54.134137 (+ 565us) server_negotiation.cc:407] Connection header received
0806 10:40:54.134349 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:54.134355 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:54.134443 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:54.134528 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:54.135907 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.136731 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.139005 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.139563 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.139708 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.141982 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:54.141987 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:54.141991 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:54.142024 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:54.145159 (+ 3135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:54.145810 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:54.145815 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:54.145819 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:54.145940 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:54.146292 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:54.146297 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:54.146301 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:54.146704 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:54.146871 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:54.148404 (+ 1533us) server_negotiation.cc:299] Negotiation successful
0806 10:40:54.148585 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 10:40:54.151695 18600 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:35789
I20260806 10:40:54.151733 18804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:35789 every 8 connection(s)
I20260806 10:40:54.153213 18600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:40:54.153525 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 18600
I20260806 10:40:54.153728 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:40:54.154302 16565 external_mini_cluster.cc:1428] Setting key b3b08181f50cc9a32db4734685684391
I20260806 10:40:54.155742 18805 heartbeater.cc:347] Connected to a master server at 127.16.45.126:36423
I20260806 10:40:54.155984 18805 heartbeater.cc:464] Registering TS with master...
I20260806 10:40:54.156603 18805 heartbeater.cc:511] Master 127.16.45.126:36423 requested a full tablet report, sending...
I20260806 10:40:54.158036 18275 ts_manager.cc:194] Registered new tserver with Master: 827850bebdb7400899b3008b3900c170 (127.16.45.66:35789)
I20260806 10:40:54.159075 18275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:45579
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:40:54.197887 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36423
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:33701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:54.524112 18810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:54.524398 18810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:54.524529 18810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:54.533556 18810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:54.533754 18810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:54.533923 18810 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 10:40:54.534052 18810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:40:54.539165 18593 heartbeater.cc:503] Master 127.16.45.126:36423 was elected leader, sending a full tablet report...
I20260806 10:40:54.545307 18810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:33701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.45.126:36423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:54.546592 18810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:54.547883 18810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:54.560774 18819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:54.560793 18821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:54.561141 18817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:54.563747 18810 server_base.cc:1034] running on GCE node
I20260806 10:40:54.564376 18810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:54.565310 18810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:54.566540 18810 hybrid_clock.cc:648] HybridClock initialized: now 1786012854566462 us; error 40 us; skew 500 ppm
I20260806 10:40:54.566848 18810 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:54 dist-test-slave-fgb3 krb5kdc[18198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012854, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:54.569923 18810 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:40:54.571482 18810 webserver.cc:460] Webserver started at http://127.16.45.67:34161/ using document root <none> and password file <none>
I20260806 10:40:54.572189 18810 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:54.572291 18810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:54.572594 18810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:54.575593 18810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "180d1d1dcae54219a6d4f69b472ddfd7"
format_stamp: "Formatted at 2026-08-06 10:40:54 on dist-test-slave-fgb3"
server_key: "f522158cc1c1c77aeb0b9c340a1d163d"
server_key_iv: "d7802e247a5499d2f5f810b257d86b4b"
server_key_version: "encryptionkey@0"
I20260806 10:40:54.576464 18810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "180d1d1dcae54219a6d4f69b472ddfd7"
format_stamp: "Formatted at 2026-08-06 10:40:54 on dist-test-slave-fgb3"
server_key: "f522158cc1c1c77aeb0b9c340a1d163d"
server_key_iv: "d7802e247a5499d2f5f810b257d86b4b"
server_key_version: "encryptionkey@0"
I20260806 10:40:54.581553 18810 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 10:40:54.584930 18830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:54.586185 18810 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:40:54.586390 18810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "180d1d1dcae54219a6d4f69b472ddfd7"
format_stamp: "Formatted at 2026-08-06 10:40:54 on dist-test-slave-fgb3"
server_key: "f522158cc1c1c77aeb0b9c340a1d163d"
server_key_iv: "d7802e247a5499d2f5f810b257d86b4b"
server_key_version: "encryptionkey@0"
I20260806 10:40:54.586593 18810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:54.598101 18810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:54.602068 18810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:54.602347 18810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:54.604861 18810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:40:54.604959 18810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:54.605098 18810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:40:54.605171 18810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 10:40:54 dist-test-slave-fgb3 krb5kdc[18198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012854, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:54.628327 18639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.605497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:44679 (local address 127.16.45.126:36423)
0806 10:40:54.605841 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:54.605846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:54.607089 (+ 1243us) server_negotiation.cc:407] Connection header received
0806 10:40:54.609285 (+ 2196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:54.609291 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:54.609380 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:54.609474 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:54.611542 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.612713 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.615040 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.615603 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.615720 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.620687 (+ 4967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:54.620692 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:54.620695 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:54.620730 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:54.624209 (+ 3479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:54.625126 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:54.625132 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:54.625135 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:54.625303 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:54.625762 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:54.625767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:54.625771 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:54.626130 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:54.626832 (+ 702us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:54.627880 (+ 1048us) server_negotiation.cc:299] Negotiation successful
0806 10:40:54.628058 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222}
I20260806 10:40:54.630127 18842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.606124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36423 (local address 127.16.45.67:44679)
0806 10:40:54.606935 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:54.606971 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:54.608970 (+ 1999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:54.609762 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:54.609774 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:54.610540 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:54.611329 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.611348 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.612917 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.612921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.614902 (+ 1981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.614915 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.615887 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.615896 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.616261 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.617126 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:54.617155 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:54.620449 (+ 3294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:54.624372 (+ 3923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:54.624383 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:54.624406 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:54.624958 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:54.625420 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:54.625425 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:54.625429 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:54.625651 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:54.626782 (+ 1131us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:54.626798 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:54.627395 (+ 597us) client_negotiation.cc:769] Sending connection context
0806 10:40:54.627782 (+ 387us) client_negotiation.cc:240] Negotiation successful
0806 10:40:54.628424 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":374,"threads_started":1}
I20260806 10:40:54.650701 18939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.636221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36423 (local address 127.16.45.67:59601)
0806 10:40:54.636962 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:54.636987 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:54.637280 (+ 293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:54.637651 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:54.637656 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:54.638149 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:54.638485 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.638497 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.639744 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.639749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.640757 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.640769 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.641483 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.641489 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.641634 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.642375 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:54.642398 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:54.643540 (+ 1142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:54.647498 (+ 3958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:54.647504 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:54.647508 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:54.647918 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:54.648665 (+ 747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:54.648671 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:54.648674 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:54.648876 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:54.649510 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:54.649515 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:54.649754 (+ 239us) client_negotiation.cc:769] Sending connection context
0806 10:40:54.649934 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 10:40:54.650191 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":388,"threads_started":1}
I20260806 10:40:54.650813 18639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.636171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:59601 (local address 127.16.45.126:36423)
0806 10:40:54.636370 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:54.636376 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:54.637135 (+ 759us) server_negotiation.cc:407] Connection header received
0806 10:40:54.637440 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:54.637446 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:54.637517 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:54.637595 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:54.638626 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.639606 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.640895 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.641298 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.641406 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.643773 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:54.643783 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:54.643788 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:54.643838 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:54.647354 (+ 3516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:54.648029 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:54.648035 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:54.648040 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:54.648230 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:54.648989 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:54.648994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:54.648997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:54.649353 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:54.649536 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:54.650116 (+ 580us) server_negotiation.cc:299] Negotiation successful
0806 10:40:54.650412 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 10:40:54.655274 18810 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:46629
I20260806 10:40:54.655332 18999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:46629 every 8 connection(s)
I20260806 10:40:54.656482 18810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:40:54.657868 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 18810
I20260806 10:40:54.658141 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:40:54.658732 16565 external_mini_cluster.cc:1428] Setting key df083fa6ebebed50c121b61e20373c17
I20260806 10:40:54.658550 19001 heartbeater.cc:347] Connected to a master server at 127.16.45.126:36423
I20260806 10:40:54.659600 19001 heartbeater.cc:464] Registering TS with master...
I20260806 10:40:54.660409 19001 heartbeater.cc:511] Master 127.16.45.126:36423 requested a full tablet report, sending...
I20260806 10:40:54.661931 18275 ts_manager.cc:194] Registered new tserver with Master: 180d1d1dcae54219a6d4f69b472ddfd7 (127.16.45.67:46629)
I20260806 10:40:54.662802 18275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:44679
I20260806 10:40:54.674023 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 10:40:54 dist-test-slave-fgb3 krb5kdc[18198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012854, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 10:40:54 dist-test-slave-fgb3 krb5kdc[18198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012854, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:54.722481 18639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.709334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51156 (local address 127.16.45.126:36423)
0806 10:40:54.709555 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:54.709563 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:54.709949 (+ 386us) server_negotiation.cc:407] Connection header received
0806 10:40:54.710175 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:54.710180 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:54.710252 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:54.710384 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:54.711720 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.712473 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.713651 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.714058 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.714150 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.717843 (+ 3693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:54.717849 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:54.717852 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:54.717910 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:54.720367 (+ 2457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:54.720912 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:54.720915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:54.720918 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:54.721034 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:54.721299 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:54.721326 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:54.721328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:54.721592 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:54.721782 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:54.721990 (+ 208us) server_negotiation.cc:299] Negotiation successful
0806 10:40:54.722159 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 10:40:54.726640 18275 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51156:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:40:54.733718 18275 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:40:54.765951 19019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.745621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56474 (local address 127.16.45.65:38731)
0806 10:40:54.756705 (+ 11084us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:54.756713 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:54.756742 (+ 29us) server_negotiation.cc:407] Connection header received
0806 10:40:54.756838 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:54.756846 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:54.757058 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:54.757209 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:54.758048 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.759970 (+ 1922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.762885 (+ 2915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.764429 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.764541 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.764771 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:54.765471 (+ 700us) server_negotiation.cc:299] Negotiation successful
0806 10:40:54.765647 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10938,"thread_start_us":10811,"threads_started":1}
I20260806 10:40:54.766259 19022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.745465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38731 (local address 127.0.0.1:56474)
0806 10:40:54.755349 (+ 9884us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:54.755410 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:54.755599 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:54.757260 (+ 1661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:54.757268 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:54.757300 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:54.757784 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.757801 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.760151 (+ 2350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.760157 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.762689 (+ 2532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.762705 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.764965 (+ 2260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.764971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.765190 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.765250 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 10:40:54.765403 (+ 153us) client_negotiation.cc:240] Negotiation successful
0806 10:40:54.765603 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9587,"mutex_wait_us":1,"thread_start_us":10300,"threads_started":1}
I20260806 10:40:54.767341 19018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.745705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:46629 (local address 127.0.0.1:49630)
0806 10:40:54.756049 (+ 10344us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:54.756068 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:54.756199 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:54.758963 (+ 2764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:54.758969 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:54.758993 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:54.759828 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.759843 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.762669 (+ 2826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.762674 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.764686 (+ 2012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.764701 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.766334 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.766343 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.766621 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.766655 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 10:40:54.766718 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 10:40:54.766844 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10213,"mutex_wait_us":19,"thread_start_us":14648,"threads_started":1}
I20260806 10:40:54.767409 19023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.746663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49630 (local address 127.16.45.67:46629)
0806 10:40:54.758484 (+ 11821us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:54.758492 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:54.758525 (+ 33us) server_negotiation.cc:407] Connection header received
0806 10:40:54.758600 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:54.758605 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:54.758791 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:54.758950 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:54.760601 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.762553 (+ 1952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.764859 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.766023 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.766530 (+ 507us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.766806 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:54.766889 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 10:40:54.767009 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11673,"thread_start_us":11419,"threads_started":1}
I20260806 10:40:54.770684 19024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.747129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44210 (local address 127.16.45.66:35789)
0806 10:40:54.757734 (+ 10605us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:54.757740 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:54.760984 (+ 3244us) server_negotiation.cc:407] Connection header received
0806 10:40:54.761134 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:54.761142 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:54.761375 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:54.761575 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:54.762204 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.763767 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.768103 (+ 4336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.769536 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.769676 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.769910 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:54.770120 (+ 210us) server_negotiation.cc:299] Negotiation successful
0806 10:40:54.770352 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10453,"thread_start_us":10340,"threads_started":1}
I20260806 10:40:54.770712 19020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.745969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:35789 (local address 127.0.0.1:44210)
0806 10:40:54.760847 (+ 14878us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:54.760865 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:54.760987 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:54.761573 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:54.761578 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:54.761606 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:54.762019 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.762031 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.763973 (+ 1942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.763978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.767874 (+ 3896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.767888 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.769768 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.769776 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.769938 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.769971 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 10:40:54.770064 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 10:40:54.770186 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14722,"mutex_wait_us":26,"thread_start_us":8915,"threads_started":1}
I20260806 10:40:54.770726 18480 tablet_service.cc:1467] Processing CreateTablet for tablet ed7cc2e5060741179118ac368b1248bd (DEFAULT_TABLE table=test-table [id=2fca3d4326074cfcb57174631fc052fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:40:54.771307 18901 tablet_service.cc:1467] Processing CreateTablet for tablet ed7cc2e5060741179118ac368b1248bd (DEFAULT_TABLE table=test-table [id=2fca3d4326074cfcb57174631fc052fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:40:54.772258 18480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed7cc2e5060741179118ac368b1248bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:54.772547 18901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed7cc2e5060741179118ac368b1248bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:54.774518 18702 tablet_service.cc:1467] Processing CreateTablet for tablet ed7cc2e5060741179118ac368b1248bd (DEFAULT_TABLE table=test-table [id=2fca3d4326074cfcb57174631fc052fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:40:54.776086 18702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed7cc2e5060741179118ac368b1248bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:54.788931 19025 tablet_bootstrap.cc:492] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067: Bootstrap starting.
I20260806 10:40:54.793867 19025 tablet_bootstrap.cc:654] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:54.795382 19027 tablet_bootstrap.cc:492] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7: Bootstrap starting.
I20260806 10:40:54.797554 19029 tablet_bootstrap.cc:492] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170: Bootstrap starting.
I20260806 10:40:54.797609 19025 log.cc:824] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:54.800411 19027 tablet_bootstrap.cc:654] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:54.801327 19029 tablet_bootstrap.cc:654] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:54.801895 19025 tablet_bootstrap.cc:492] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067: No bootstrap required, opened a new log
I20260806 10:40:54.802241 19027 log.cc:824] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:54.802304 19025 ts_tablet_manager.cc:1397] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.001s
I20260806 10:40:54.802541 19029 log.cc:824] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:54.805701 19029 tablet_bootstrap.cc:492] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170: No bootstrap required, opened a new log
I20260806 10:40:54.805735 19027 tablet_bootstrap.cc:492] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7: No bootstrap required, opened a new log
I20260806 10:40:54.806003 19027 ts_tablet_manager.cc:1397] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.007s
I20260806 10:40:54.806003 19029 ts_tablet_manager.cc:1397] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260806 10:40:54.810850 19025 raft_consensus.cc:348] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } }
I20260806 10:40:54.811225 19025 raft_consensus.cc:374] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:54.811345 19025 raft_consensus.cc:729] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9abca473091541928880c3a6324bd067, State: Initialized, Role: FOLLOWER
I20260806 10:40:54.811956 19025 consensus_queue.cc:260] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } }
I20260806 10:40:54.813777 19025 ts_tablet_manager.cc:1428] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067: Time spent starting tablet: real 0.011s user 0.009s sys 0.001s
I20260806 10:40:54.816418 19027 raft_consensus.cc:348] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } }
I20260806 10:40:54.816416 19029 raft_consensus.cc:348] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } }
I20260806 10:40:54.816862 19029 raft_consensus.cc:374] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:54.816862 19027 raft_consensus.cc:374] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:54.816965 19027 raft_consensus.cc:729] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 180d1d1dcae54219a6d4f69b472ddfd7, State: Initialized, Role: FOLLOWER
I20260806 10:40:54.816967 19029 raft_consensus.cc:729] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 827850bebdb7400899b3008b3900c170, State: Initialized, Role: FOLLOWER
I20260806 10:40:54.817605 19027 consensus_queue.cc:260] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } }
I20260806 10:40:54.817659 19029 consensus_queue.cc:260] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } }
I20260806 10:40:54.818857 19001 heartbeater.cc:503] Master 127.16.45.126:36423 was elected leader, sending a full tablet report...
I20260806 10:40:54.819269 18805 heartbeater.cc:503] Master 127.16.45.126:36423 was elected leader, sending a full tablet report...
I20260806 10:40:54.819509 19027 ts_tablet_manager.cc:1428] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260806 10:40:54.819847 19029 ts_tablet_manager.cc:1428] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170: Time spent starting tablet: real 0.014s user 0.009s sys 0.006s
W20260806 10:40:54.905386 18806 tablet.cc:2369] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:40:54.908116 19002 tablet.cc:2369] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:40:54.968585 19033 raft_consensus.cc:482] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:40:54.968902 19033 raft_consensus.cc:504] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } }
I20260806 10:40:54.970623 19033 leader_election.cc:288] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 180d1d1dcae54219a6d4f69b472ddfd7 (127.16.45.67:46629), 827850bebdb7400899b3008b3900c170 (127.16.45.66:35789)
I20260806 10:40:54.977627 19023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.971044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:39373 (local address 127.16.45.67:46629)
0806 10:40:54.971258 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:54.971264 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:54.972229 (+ 965us) server_negotiation.cc:407] Connection header received
0806 10:40:54.972413 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:54.972418 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:54.972497 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:54.972594 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:54.973162 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.973885 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.975897 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.976701 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.976854 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.976930 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:54.977244 (+ 314us) server_negotiation.cc:299] Negotiation successful
0806 10:40:54.977383 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 10:40:54.977662 19024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.971110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:56455 (local address 127.16.45.66:35789)
0806 10:40:54.971327 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:54.971333 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:54.972016 (+ 683us) server_negotiation.cc:407] Connection header received
0806 10:40:54.972186 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:54.972192 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:54.972276 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:54.972363 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:54.973024 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.973793 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.975833 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.976702 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.976854 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.976931 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:54.977292 (+ 361us) server_negotiation.cc:299] Negotiation successful
0806 10:40:54.977421 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 10:40:54.977777 19039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.970994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:35789 (local address 127.16.45.65:56455)
0806 10:40:54.971882 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:54.971903 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:54.972048 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:54.972400 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:54.972404 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:54.972431 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:54.972855 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.972870 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.973948 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.973954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.975689 (+ 1735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.975705 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.976982 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.976987 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.977131 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.977155 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 10:40:54.977247 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 10:40:54.977375 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"mutex_wait_us":65,"thread_start_us":489,"threads_started":1}
I20260806 10:40:54.977818 19041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:54.971061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:46629 (local address 127.16.45.65:39373)
0806 10:40:54.972113 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:54.972136 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:54.972264 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:54.972620 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:54.972623 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:54.972643 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:54.973003 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.973014 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.974017 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.974020 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.975736 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:54.975749 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:54.976928 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:54.976935 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:54.977076 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:54.977118 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 10:40:54.977189 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 10:40:54.977311 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":907,"mutex_wait_us":26,"thread_start_us":495,"threads_started":1}
I20260806 10:40:54.978892 18735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed7cc2e5060741179118ac368b1248bd" candidate_uuid: "9abca473091541928880c3a6324bd067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827850bebdb7400899b3008b3900c170" is_pre_election: true
I20260806 10:40:54.978899 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed7cc2e5060741179118ac368b1248bd" candidate_uuid: "9abca473091541928880c3a6324bd067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" is_pre_election: true
I20260806 10:40:54.979365 18735 raft_consensus.cc:2454] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9abca473091541928880c3a6324bd067 in term 0.
I20260806 10:40:54.979364 18932 raft_consensus.cc:2454] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9abca473091541928880c3a6324bd067 in term 0.
I20260806 10:40:54.980047 18410 leader_election.cc:302] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 180d1d1dcae54219a6d4f69b472ddfd7, 827850bebdb7400899b3008b3900c170, 9abca473091541928880c3a6324bd067; no voters:
I20260806 10:40:54.980458 19033 raft_consensus.cc:2781] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:40:54.980590 19033 raft_consensus.cc:482] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:40:54.980695 19033 raft_consensus.cc:3037] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:54.983001 19033 raft_consensus.cc:504] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } }
I20260806 10:40:54.983626 19033 leader_election.cc:288] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [CANDIDATE]: Term 1 election: Requested vote from peers 180d1d1dcae54219a6d4f69b472ddfd7 (127.16.45.67:46629), 827850bebdb7400899b3008b3900c170 (127.16.45.66:35789)
I20260806 10:40:54.984126 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed7cc2e5060741179118ac368b1248bd" candidate_uuid: "9abca473091541928880c3a6324bd067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "180d1d1dcae54219a6d4f69b472ddfd7"
I20260806 10:40:54.984155 18735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed7cc2e5060741179118ac368b1248bd" candidate_uuid: "9abca473091541928880c3a6324bd067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827850bebdb7400899b3008b3900c170"
I20260806 10:40:54.984325 18735 raft_consensus.cc:3037] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:54.984347 18932 raft_consensus.cc:3037] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:54.986593 18735 raft_consensus.cc:2454] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9abca473091541928880c3a6324bd067 in term 1.
I20260806 10:40:54.986618 18932 raft_consensus.cc:2454] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9abca473091541928880c3a6324bd067 in term 1.
I20260806 10:40:54.986986 18410 leader_election.cc:302] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 827850bebdb7400899b3008b3900c170, 9abca473091541928880c3a6324bd067; no voters:
I20260806 10:40:54.987282 19033 raft_consensus.cc:2781] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:40:54.987715 19033 raft_consensus.cc:686] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 1 LEADER]: Becoming Leader. State: Replica: 9abca473091541928880c3a6324bd067, State: Running, Role: LEADER
I20260806 10:40:54.988227 19033 consensus_queue.cc:237] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } }
I20260806 10:40:54.993438 18275 catalog_manager.cc:5495] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9abca473091541928880c3a6324bd067 (127.16.45.65). New cstate: current_term: 1 leader_uuid: "9abca473091541928880c3a6324bd067" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } health_report { overall_health: UNKNOWN } } }
W20260806 10:40:55.032966 18595 tablet.cc:2369] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:40:55.079305 19019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.073637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56476 (local address 127.16.45.65:38731)
0806 10:40:55.073809 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:55.073814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:55.073990 (+ 176us) server_negotiation.cc:407] Connection header received
0806 10:40:55.074286 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:55.074290 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:55.074401 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:55.074548 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:40:55.074904 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.075686 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.077100 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.077505 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.077596 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:55.078067 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:40:55.078799 (+ 732us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:40:55.078908 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:55.079017 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 10:40:55.079096 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 10:40:55.088573 18735 raft_consensus.cc:1261] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170 [term 1 FOLLOWER]: Refusing update from remote peer 9abca473091541928880c3a6324bd067: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:40:55.089840 19043 consensus_queue.cc:1035] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:40:55.090050 18932 raft_consensus.cc:1261] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7 [term 1 FOLLOWER]: Refusing update from remote peer 9abca473091541928880c3a6324bd067: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:40:55.090816 19043 consensus_queue.cc:1035] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:40:55.103618 19052 mvcc.cc:205] Tried to move back new op lower bound from 7315508654430806016 to 7315508654036156416. Current Snapshot: MvccSnapshot[applied={T|T < 7315508654430806016}]
I20260806 10:40:55.126019 18272 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:40:55.126485 18272 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:40:55.132844 18272 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766: Sending DeleteTablet for 3 replicas of tablet ed7cc2e5060741179118ac368b1248bd
I20260806 10:40:55.134339 18480 tablet_service.cc:1514] Processing DeleteTablet for tablet ed7cc2e5060741179118ac368b1248bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:40:55 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:56474
I20260806 10:40:55.134672 18901 tablet_service.cc:1514] Processing DeleteTablet for tablet ed7cc2e5060741179118ac368b1248bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:40:55 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:49630
I20260806 10:40:55.134698 18702 tablet_service.cc:1514] Processing DeleteTablet for tablet ed7cc2e5060741179118ac368b1248bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:40:55 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:44210
I20260806 10:40:55.142622 18272 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51156:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:40:55.143736 18272 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:40:55.145539 19063 tablet_replica.cc:330] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067: stopping tablet replica
I20260806 10:40:55.145973 19066 tablet_replica.cc:330] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170: stopping tablet replica
I20260806 10:40:55.146203 19063 raft_consensus.cc:2229] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:40:55.146615 19066 raft_consensus.cc:2229] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:40:55.147248 19063 raft_consensus.cc:2258] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:40:55.147315 19066 raft_consensus.cc:2258] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:40:55.149616 19064 tablet_replica.cc:330] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7: stopping tablet replica
I20260806 10:40:55.150070 19064 raft_consensus.cc:2229] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:40:55.150564 19064 raft_consensus.cc:2258] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:40:55.152212 18898 tablet_service.cc:1467] Processing CreateTablet for tablet 49ded0ed60e447aa9f7cfa34b351c9ab (DEFAULT_TABLE table=test-table [id=9201d53e3a51494595694e7e3227686f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:40:55.152662 18898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49ded0ed60e447aa9f7cfa34b351c9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:55.152925 19066 ts_tablet_manager.cc:1905] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:40:55.155639 18480 tablet_service.cc:1467] Processing CreateTablet for tablet 49ded0ed60e447aa9f7cfa34b351c9ab (DEFAULT_TABLE table=test-table [id=9201d53e3a51494595694e7e3227686f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:40:55.156198 18480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49ded0ed60e447aa9f7cfa34b351c9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:55.164551 19027 tablet_bootstrap.cc:492] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7: Bootstrap starting.
I20260806 10:40:55.166483 19027 tablet_bootstrap.cc:654] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:55.167236 19066 ts_tablet_manager.cc:1918] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:40:55.167498 19066 log.cc:1196] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/ed7cc2e5060741179118ac368b1248bd
I20260806 10:40:55.168329 19066 ts_tablet_manager.cc:1939] T ed7cc2e5060741179118ac368b1248bd P 827850bebdb7400899b3008b3900c170: Deleting consensus metadata
I20260806 10:40:55.170045 19025 tablet_bootstrap.cc:492] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067: Bootstrap starting.
I20260806 10:40:55.170403 18702 tablet_service.cc:1467] Processing CreateTablet for tablet 49ded0ed60e447aa9f7cfa34b351c9ab (DEFAULT_TABLE table=test-table [id=9201d53e3a51494595694e7e3227686f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:40:55.170938 18702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49ded0ed60e447aa9f7cfa34b351c9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:55.172365 19025 tablet_bootstrap.cc:654] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:55.173100 19063 ts_tablet_manager.cc:1905] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:40:55.172039 18251 catalog_manager.cc:4841] TS 827850bebdb7400899b3008b3900c170 (127.16.45.66:35789): tablet ed7cc2e5060741179118ac368b1248bd (table test-table [id=2fca3d4326074cfcb57174631fc052fc]) successfully deleted
I20260806 10:40:55.173946 19064 ts_tablet_manager.cc:1905] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:40:55.180763 19029 tablet_bootstrap.cc:492] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170: Bootstrap starting.
I20260806 10:40:55.183241 19029 tablet_bootstrap.cc:654] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:55.186556 19027 tablet_bootstrap.cc:492] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7: No bootstrap required, opened a new log
I20260806 10:40:55.186798 19027 ts_tablet_manager.cc:1397] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.008s
I20260806 10:40:55.187873 19027 raft_consensus.cc:348] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.188268 19027 raft_consensus.cc:374] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:55.188407 19027 raft_consensus.cc:729] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 180d1d1dcae54219a6d4f69b472ddfd7, State: Initialized, Role: FOLLOWER
I20260806 10:40:55.188741 19027 consensus_queue.cc:260] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.189538 19027 ts_tablet_manager.cc:1428] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 10:40:55.193058 19029 tablet_bootstrap.cc:492] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170: No bootstrap required, opened a new log
I20260806 10:40:55.193286 19029 ts_tablet_manager.cc:1397] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260806 10:40:55.193953 19064 ts_tablet_manager.cc:1918] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:40:55.194200 19064 log.cc:1196] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/ed7cc2e5060741179118ac368b1248bd
I20260806 10:40:55.194481 19029 raft_consensus.cc:348] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.194737 19029 raft_consensus.cc:374] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:55.194831 19064 ts_tablet_manager.cc:1939] T ed7cc2e5060741179118ac368b1248bd P 180d1d1dcae54219a6d4f69b472ddfd7: Deleting consensus metadata
I20260806 10:40:55.194957 19029 raft_consensus.cc:729] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 827850bebdb7400899b3008b3900c170, State: Initialized, Role: FOLLOWER
I20260806 10:40:55.195508 19029 consensus_queue.cc:260] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.196003 19063 ts_tablet_manager.cc:1918] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:40:55.196228 19063 log.cc:1196] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/ed7cc2e5060741179118ac368b1248bd
I20260806 10:40:55.196786 19025 tablet_bootstrap.cc:492] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067: No bootstrap required, opened a new log
I20260806 10:40:55.197019 18252 catalog_manager.cc:4841] TS 180d1d1dcae54219a6d4f69b472ddfd7 (127.16.45.67:46629): tablet ed7cc2e5060741179118ac368b1248bd (table test-table [id=2fca3d4326074cfcb57174631fc052fc]) successfully deleted
I20260806 10:40:55.197360 19029 ts_tablet_manager.cc:1428] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260806 10:40:55.197796 19063 ts_tablet_manager.cc:1939] T ed7cc2e5060741179118ac368b1248bd P 9abca473091541928880c3a6324bd067: Deleting consensus metadata
I20260806 10:40:55.198954 19025 ts_tablet_manager.cc:1397] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.012s
I20260806 10:40:55.203161 19025 raft_consensus.cc:348] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.203425 19025 raft_consensus.cc:374] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:55.203543 19025 raft_consensus.cc:729] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9abca473091541928880c3a6324bd067, State: Initialized, Role: FOLLOWER
I20260806 10:40:55.203548 18253 catalog_manager.cc:4841] TS 9abca473091541928880c3a6324bd067 (127.16.45.65:38731): tablet ed7cc2e5060741179118ac368b1248bd (table test-table [id=2fca3d4326074cfcb57174631fc052fc]) successfully deleted
I20260806 10:40:55.203815 19025 consensus_queue.cc:260] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.204604 19025 ts_tablet_manager.cc:1428] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260806 10:40:55.298354 19033 raft_consensus.cc:482] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:40:55.298627 19033 raft_consensus.cc:504] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.300005 19033 leader_election.cc:288] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 827850bebdb7400899b3008b3900c170 (127.16.45.66:35789), 180d1d1dcae54219a6d4f69b472ddfd7 (127.16.45.67:46629)
I20260806 10:40:55.300092 18735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49ded0ed60e447aa9f7cfa34b351c9ab" candidate_uuid: "9abca473091541928880c3a6324bd067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827850bebdb7400899b3008b3900c170" is_pre_election: true
I20260806 10:40:55.300062 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49ded0ed60e447aa9f7cfa34b351c9ab" candidate_uuid: "9abca473091541928880c3a6324bd067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" is_pre_election: true
I20260806 10:40:55.300336 18932 raft_consensus.cc:2454] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9abca473091541928880c3a6324bd067 in term 0.
I20260806 10:40:55.300359 18735 raft_consensus.cc:2454] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9abca473091541928880c3a6324bd067 in term 0.
I20260806 10:40:55.300803 18412 leader_election.cc:302] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 180d1d1dcae54219a6d4f69b472ddfd7, 9abca473091541928880c3a6324bd067; no voters:
I20260806 10:40:55.301184 19033 raft_consensus.cc:2781] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:40:55.301312 19033 raft_consensus.cc:482] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:40:55.301501 19033 raft_consensus.cc:3037] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:55.305248 19033 raft_consensus.cc:504] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.306052 19033 leader_election.cc:288] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [CANDIDATE]: Term 1 election: Requested vote from peers 827850bebdb7400899b3008b3900c170 (127.16.45.66:35789), 180d1d1dcae54219a6d4f69b472ddfd7 (127.16.45.67:46629)
I20260806 10:40:55.306638 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49ded0ed60e447aa9f7cfa34b351c9ab" candidate_uuid: "9abca473091541928880c3a6324bd067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "180d1d1dcae54219a6d4f69b472ddfd7"
I20260806 10:40:55.306638 18735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49ded0ed60e447aa9f7cfa34b351c9ab" candidate_uuid: "9abca473091541928880c3a6324bd067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827850bebdb7400899b3008b3900c170"
I20260806 10:40:55.306879 18932 raft_consensus.cc:3037] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:55.306885 18735 raft_consensus.cc:3037] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:55.310111 18735 raft_consensus.cc:2454] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9abca473091541928880c3a6324bd067 in term 1.
I20260806 10:40:55.310111 18932 raft_consensus.cc:2454] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9abca473091541928880c3a6324bd067 in term 1.
I20260806 10:40:55.310635 18412 leader_election.cc:302] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 180d1d1dcae54219a6d4f69b472ddfd7, 9abca473091541928880c3a6324bd067; no voters:
I20260806 10:40:55.310930 19033 raft_consensus.cc:2781] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:40:55.311240 19033 raft_consensus.cc:686] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 1 LEADER]: Becoming Leader. State: Replica: 9abca473091541928880c3a6324bd067, State: Running, Role: LEADER
I20260806 10:40:55.311527 19033 consensus_queue.cc:237] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.315683 18272 catalog_manager.cc:5495] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9abca473091541928880c3a6324bd067 (127.16.45.65). New cstate: current_term: 1 leader_uuid: "9abca473091541928880c3a6324bd067" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } health_report { overall_health: UNKNOWN } } }
Aug 06 10:40:55 dist-test-slave-fgb3 krb5kdc[18198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012852, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:55.395804 19080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.381085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36423 (local address 127.0.0.1:51158)
0806 10:40:55.381977 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:55.382001 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:55.382165 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:55.382583 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:55.382592 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:55.383226 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:55.383446 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:55.383455 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.384485 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.384489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:55.385424 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:55.385434 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.386112 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.386118 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:55.386309 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:55.387117 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:55.387134 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:55.389751 (+ 2617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:55.392877 (+ 3126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:55.392891 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:55.392899 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:55.393494 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:55.393899 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:55.393904 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:55.393908 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:55.394079 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:55.394634 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:55.394643 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:55.394839 (+ 196us) client_negotiation.cc:769] Sending connection context
0806 10:40:55.395034 (+ 195us) client_negotiation.cc:240] Negotiation successful
0806 10:40:55.395334 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"thread_start_us":550,"threads_started":1}
I20260806 10:40:55.395828 19082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.381097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51158 (local address 127.16.45.126:36423)
0806 10:40:55.382293 (+ 1196us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:55.382297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:55.382339 (+ 42us) server_negotiation.cc:407] Connection header received
0806 10:40:55.382390 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:55.382393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:55.382448 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:55.382538 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:55.383586 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.384346 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.385554 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.385965 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.386069 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:55.389981 (+ 3912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:55.389987 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:55.389990 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:55.390019 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:55.392713 (+ 2694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:55.393625 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:55.393629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:55.393631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:55.393790 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:55.394183 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:55.394186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:55.394188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:55.394508 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:55.394619 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:55.395121 (+ 502us) server_negotiation.cc:299] Negotiation successful
0806 10:40:55.395515 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":188,"server-negotiator.queue_time_us":1051,"thread_start_us":915,"threads_started":1}
I20260806 10:40:55.401762 18272 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:51158:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 10:40:55.403275 18272 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:40:55.411116 18480 tablet_service.cc:1467] Processing CreateTablet for tablet a348b426d24341968f47b356ee0c9ad3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=366fc7a6714e4e918c03de41acbe7d62]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 10:40:55.411684 18480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a348b426d24341968f47b356ee0c9ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:55.411947 18702 tablet_service.cc:1467] Processing CreateTablet for tablet a348b426d24341968f47b356ee0c9ad3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=366fc7a6714e4e918c03de41acbe7d62]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 10:40:55.412506 18702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a348b426d24341968f47b356ee0c9ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:55.418998 18898 tablet_service.cc:1467] Processing CreateTablet for tablet a348b426d24341968f47b356ee0c9ad3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=366fc7a6714e4e918c03de41acbe7d62]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 10:40:55.419631 18898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a348b426d24341968f47b356ee0c9ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:55.420288 19029 tablet_bootstrap.cc:492] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170: Bootstrap starting.
I20260806 10:40:55.422266 19029 tablet_bootstrap.cc:654] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:55.425137 19025 tablet_bootstrap.cc:492] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: Bootstrap starting.
I20260806 10:40:55.426797 19029 tablet_bootstrap.cc:492] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170: No bootstrap required, opened a new log
I20260806 10:40:55.427026 19029 ts_tablet_manager.cc:1397] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260806 10:40:55.427166 19025 tablet_bootstrap.cc:654] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:55.427572 19027 tablet_bootstrap.cc:492] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7: Bootstrap starting.
I20260806 10:40:55.427996 19029 raft_consensus.cc:348] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.428278 19029 raft_consensus.cc:374] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:55.428355 19029 raft_consensus.cc:729] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 827850bebdb7400899b3008b3900c170, State: Initialized, Role: FOLLOWER
I20260806 10:40:55.428706 19029 consensus_queue.cc:260] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.429411 19029 ts_tablet_manager.cc:1428] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 10:40:55.429466 19027 tablet_bootstrap.cc:654] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:55.430920 19034 tablet_replica.cc:439] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } }
I20260806 10:40:55.431305 19034 tablet_replica.cc:442] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:40:55.432344 19025 tablet_bootstrap.cc:492] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: No bootstrap required, opened a new log
I20260806 10:40:55.432710 19025 ts_tablet_manager.cc:1397] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20260806 10:40:55.434356 19027 tablet_bootstrap.cc:492] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7: No bootstrap required, opened a new log
I20260806 10:40:55.434628 19027 ts_tablet_manager.cc:1397] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260806 10:40:55.434631 19025 raft_consensus.cc:348] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.434909 19025 raft_consensus.cc:374] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:55.435026 19025 raft_consensus.cc:729] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9abca473091541928880c3a6324bd067, State: Initialized, Role: FOLLOWER
I20260806 10:40:55.435307 19025 consensus_queue.cc:260] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.436004 19025 ts_tablet_manager.cc:1428] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260806 10:40:55.435798 19033 tablet_replica.cc:439] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } }
I20260806 10:40:55.436228 19033 tablet_replica.cc:442] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:40:55.435626 19027 raft_consensus.cc:348] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.436618 19027 raft_consensus.cc:374] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:55.436753 19027 raft_consensus.cc:729] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 180d1d1dcae54219a6d4f69b472ddfd7, State: Initialized, Role: FOLLOWER
I20260806 10:40:55.437134 19027 consensus_queue.cc:260] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.437660 19027 ts_tablet_manager.cc:1428] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260806 10:40:55.437703 19035 tablet_replica.cc:439] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } }
I20260806 10:40:55.438201 19035 tablet_replica.cc:442] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:40:55.688903 19035 raft_consensus.cc:482] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:40:55.689265 19035 raft_consensus.cc:504] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.691442 19035 leader_election.cc:288] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9abca473091541928880c3a6324bd067 (127.16.45.65:38731), 827850bebdb7400899b3008b3900c170 (127.16.45.66:35789)
I20260806 10:40:55.694272 19033 raft_consensus.cc:482] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:40:55.694522 19033 raft_consensus.cc:504] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.696511 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a348b426d24341968f47b356ee0c9ad3" candidate_uuid: "9abca473091541928880c3a6324bd067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" is_pre_election: true
I20260806 10:40:55.697021 18932 raft_consensus.cc:2454] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9abca473091541928880c3a6324bd067 in term 0.
I20260806 10:40:55.698063 18412 leader_election.cc:302] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 180d1d1dcae54219a6d4f69b472ddfd7, 9abca473091541928880c3a6324bd067; no voters:
I20260806 10:40:55.698523 19033 leader_election.cc:288] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 827850bebdb7400899b3008b3900c170 (127.16.45.66:35789), 180d1d1dcae54219a6d4f69b472ddfd7 (127.16.45.67:46629)
I20260806 10:40:55.698706 19043 raft_consensus.cc:2781] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:40:55.698984 19043 raft_consensus.cc:482] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:40:55.699142 19043 raft_consensus.cc:3037] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:55.703764 19043 raft_consensus.cc:504] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.705175 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a348b426d24341968f47b356ee0c9ad3" candidate_uuid: "9abca473091541928880c3a6324bd067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "180d1d1dcae54219a6d4f69b472ddfd7"
I20260806 10:40:55.705442 18932 raft_consensus.cc:3037] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:55.707201 19043 leader_election.cc:288] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [CANDIDATE]: Term 1 election: Requested vote from peers 827850bebdb7400899b3008b3900c170 (127.16.45.66:35789), 180d1d1dcae54219a6d4f69b472ddfd7 (127.16.45.67:46629)
I20260806 10:40:55.708117 18735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a348b426d24341968f47b356ee0c9ad3" candidate_uuid: "9abca473091541928880c3a6324bd067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827850bebdb7400899b3008b3900c170" is_pre_election: true
I20260806 10:40:55.708293 18734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a348b426d24341968f47b356ee0c9ad3" candidate_uuid: "9abca473091541928880c3a6324bd067" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827850bebdb7400899b3008b3900c170"
I20260806 10:40:55.708412 18735 raft_consensus.cc:2454] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9abca473091541928880c3a6324bd067 in term 0.
I20260806 10:40:55.710960 18932 raft_consensus.cc:2454] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9abca473091541928880c3a6324bd067 in term 1.
I20260806 10:40:55.711474 18412 leader_election.cc:302] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 180d1d1dcae54219a6d4f69b472ddfd7, 9abca473091541928880c3a6324bd067; no voters: 827850bebdb7400899b3008b3900c170
I20260806 10:40:55.711936 19043 raft_consensus.cc:2781] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:40:55.712332 19043 raft_consensus.cc:686] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [term 1 LEADER]: Becoming Leader. State: Replica: 9abca473091541928880c3a6324bd067, State: Running, Role: LEADER
I20260806 10:40:55.712682 19043 consensus_queue.cc:237] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } }
I20260806 10:40:55.714679 19033 tablet_replica.cc:439] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: TxnStatusTablet state changed. Reason: New leader 9abca473091541928880c3a6324bd067. Latest consensus state: current_term: 1 leader_uuid: "9abca473091541928880c3a6324bd067" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } }
I20260806 10:40:55.715195 19033 tablet_replica.cc:442] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: This TxnStatusTablet replica's current role is: LEADER
I20260806 10:40:55.715305 19093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.691627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38731 (local address 127.16.45.67:60691)
0806 10:40:55.705165 (+ 13538us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:55.705190 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:55.706037 (+ 847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:55.706805 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:55.706810 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:55.706892 (+ 82us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:55.708161 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:55.708178 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.710175 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.710181 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:55.712590 (+ 2409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:55.712606 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.714505 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.714512 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:55.714687 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:55.714725 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 10:40:55.714793 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 10:40:55.714932 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13375,"thread_start_us":13241,"threads_started":1}
I20260806 10:40:55.716032 19092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.691941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:35789 (local address 127.16.45.67:39573)
0806 10:40:55.707885 (+ 15944us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:55.707915 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:55.708352 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:55.708905 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:55.708909 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:55.708934 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:55.709548 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:55.709561 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.710887 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.710892 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:55.713355 (+ 2463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:55.713372 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.715318 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.715326 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:55.715528 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:55.715558 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 10:40:55.715637 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 10:40:55.715764 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15824,"thread_start_us":14594,"threads_started":1}
I20260806 10:40:55.716528 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.692084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:39573 (local address 127.16.45.66:35789)
0806 10:40:55.707505 (+ 15421us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:55.707510 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:55.708000 (+ 490us) server_negotiation.cc:407] Connection header received
0806 10:40:55.708502 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:55.708507 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:55.708575 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:55.708659 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:55.709705 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.710728 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.713590 (+ 2862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.714945 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.715103 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:55.715175 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:55.715938 (+ 763us) server_negotiation.cc:299] Negotiation successful
0806 10:40:55.716075 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15278,"thread_start_us":15151,"threads_started":1}
I20260806 10:40:55.716673 19096 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 10:40:55.716965 19096 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 10:40:55.717159 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.691796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:60691 (local address 127.16.45.65:38731)
0806 10:40:55.705361 (+ 13565us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:55.705368 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:55.705391 (+ 23us) server_negotiation.cc:407] Connection header received
0806 10:40:55.706350 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:55.706355 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:55.706443 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:55.706562 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:55.708409 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.710032 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.712848 (+ 2816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.714280 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.716247 (+ 1967us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:55.716328 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:55.716385 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 10:40:55.716525 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13432,"thread_start_us":15541,"threads_started":1}
I20260806 10:40:55.717283 18734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a348b426d24341968f47b356ee0c9ad3" candidate_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "827850bebdb7400899b3008b3900c170" is_pre_election: true
I20260806 10:40:55.717590 18734 raft_consensus.cc:2454] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 180d1d1dcae54219a6d4f69b472ddfd7 in term 0.
I20260806 10:40:55.718230 18833 leader_election.cc:302] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 180d1d1dcae54219a6d4f69b472ddfd7, 827850bebdb7400899b3008b3900c170; no voters:
I20260806 10:40:55.718219 18275 catalog_manager.cc:5495] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9abca473091541928880c3a6324bd067 (127.16.45.65). New cstate: current_term: 1 leader_uuid: "9abca473091541928880c3a6324bd067" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } health_report { overall_health: UNKNOWN } } }
I20260806 10:40:55.718219 18510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a348b426d24341968f47b356ee0c9ad3" candidate_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9abca473091541928880c3a6324bd067" is_pre_election: true
I20260806 10:40:55.718837 19035 raft_consensus.cc:2741] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260806 10:40:55.795325 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.788953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56486 (local address 127.16.45.65:38731)
0806 10:40:55.789208 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:55.789215 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:55.789521 (+ 306us) server_negotiation.cc:407] Connection header received
0806 10:40:55.789769 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:55.789773 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:55.789842 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:55.789917 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:40:55.790487 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.791515 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.793272 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.793741 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.793861 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:55.794537 (+ 676us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:40:55.794647 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:40:55.794725 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:55.794888 (+ 163us) server_negotiation.cc:299] Negotiation successful
0806 10:40:55.794970 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 10:40:55.795501 19080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.789128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38731 (local address 127.0.0.1:56486)
0806 10:40:55.789395 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:55.789421 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:55.789595 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:55.789961 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:55.789965 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:55.789978 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 10:40:55.790338 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:55.790353 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.791635 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.791641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:55.793124 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:55.793138 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.793894 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.793900 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:55.794261 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:55.794355 (+ 94us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 10:40:55.794750 (+ 395us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 10:40:55.794772 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 10:40:55.794846 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 10:40:55.795037 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260806 10:40:55.800532 18734 raft_consensus.cc:3037] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:55.800989 18932 raft_consensus.cc:1261] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7 [term 1 FOLLOWER]: Refusing update from remote peer 9abca473091541928880c3a6324bd067: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:40:55.801815 19043 consensus_queue.cc:1035] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:40:55.803934 18734 raft_consensus.cc:1261] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170 [term 1 FOLLOWER]: Refusing update from remote peer 9abca473091541928880c3a6324bd067: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:40:55.804963 19043 consensus_queue.cc:1035] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:40:55.811812 19043 consensus_queue.cc:1035] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:40:55.817049 19035 tablet_replica.cc:439] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7: TxnStatusTablet state changed. Reason: New leader 9abca473091541928880c3a6324bd067. Latest consensus state: current_term: 1 leader_uuid: "9abca473091541928880c3a6324bd067" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } }
I20260806 10:40:55.817515 19035 tablet_replica.cc:442] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:40:55.819211 19034 tablet_replica.cc:439] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170: TxnStatusTablet state changed. Reason: New leader 9abca473091541928880c3a6324bd067. Latest consensus state: current_term: 1 leader_uuid: "9abca473091541928880c3a6324bd067" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } }
I20260806 10:40:55.819733 19034 tablet_replica.cc:442] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:40:55.823360 19033 tablet_replica.cc:439] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9abca473091541928880c3a6324bd067" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } }
I20260806 10:40:55.823688 19033 tablet_replica.cc:442] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: This TxnStatusTablet replica's current role is: LEADER
I20260806 10:40:55.825639 19033 consensus_queue.cc:1035] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:40:55.830842 19034 tablet_replica.cc:439] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9abca473091541928880c3a6324bd067" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } }
I20260806 10:40:55.831157 19034 tablet_replica.cc:442] T a348b426d24341968f47b356ee0c9ad3 P 827850bebdb7400899b3008b3900c170: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:40:55.837690 19033 tablet_replica.cc:439] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9abca473091541928880c3a6324bd067" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } }
I20260806 10:40:55.838204 19033 tablet_replica.cc:442] T a348b426d24341968f47b356ee0c9ad3 P 9abca473091541928880c3a6324bd067: This TxnStatusTablet replica's current role is: LEADER
I20260806 10:40:55.851413 19035 tablet_replica.cc:439] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9abca473091541928880c3a6324bd067" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9abca473091541928880c3a6324bd067" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38731 } } peers { permanent_uuid: "827850bebdb7400899b3008b3900c170" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35789 } } peers { permanent_uuid: "180d1d1dcae54219a6d4f69b472ddfd7" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 46629 } } }
I20260806 10:40:55.851908 19035 tablet_replica.cc:442] T a348b426d24341968f47b356ee0c9ad3 P 180d1d1dcae54219a6d4f69b472ddfd7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:40:55.868623 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.860045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:36355 (local address 127.16.45.65:38731)
0806 10:40:55.860247 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:55.860254 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:55.861895 (+ 1641us) server_negotiation.cc:407] Connection header received
0806 10:40:55.862147 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:55.862150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:55.862211 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:55.862282 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:40:55.863102 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.864081 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.866256 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.866819 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.866932 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:55.867592 (+ 660us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:40:55.867715 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:40:55.867804 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:55.867992 (+ 188us) server_negotiation.cc:299] Negotiation successful
0806 10:40:55.868097 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":72}
I20260806 10:40:55.868897 19114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.860416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38731 (local address 127.16.45.65:36355)
0806 10:40:55.861797 (+ 1381us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:55.861814 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:55.861974 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:55.862343 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:55.862347 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:55.862357 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 10:40:55.862948 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:55.862961 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.864204 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.864208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:55.866125 (+ 1917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:55.866139 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.867076 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.867082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:55.867319 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:55.867382 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 10:40:55.867831 (+ 449us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 10:40:55.867867 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 10:40:55.867968 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 10:40:55.868186 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1235,"thread_start_us":823,"threads_started":1}
I20260806 10:40:55.944199 18275 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:40:55.944487 18275 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51156:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:40:55.947840 18275 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f032be82b24b4815a5d47704c7e6b766: Sending DeleteTablet for 3 replicas of tablet 49ded0ed60e447aa9f7cfa34b351c9ab
I20260806 10:40:55.948688 18480 tablet_service.cc:1514] Processing DeleteTablet for tablet 49ded0ed60e447aa9f7cfa34b351c9ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:40:55 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:56474
I20260806 10:40:55.948832 18702 tablet_service.cc:1514] Processing DeleteTablet for tablet 49ded0ed60e447aa9f7cfa34b351c9ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:40:55 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:44210
I20260806 10:40:55.949299 18898 tablet_service.cc:1514] Processing DeleteTablet for tablet 49ded0ed60e447aa9f7cfa34b351c9ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:40:55 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:49630
I20260806 10:40:55.949549 19124 tablet_replica.cc:330] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170: stopping tablet replica
I20260806 10:40:55.949783 19124 raft_consensus.cc:2229] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:40:55.950274 19124 raft_consensus.cc:2258] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:40:55.951505 19124 ts_tablet_manager.cc:1905] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:40:55.954489 19125 tablet_replica.cc:330] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7: stopping tablet replica
I20260806 10:40:55.955257 19125 raft_consensus.cc:2229] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:40:55.955885 19125 raft_consensus.cc:2258] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:40:55.957319 19125 ts_tablet_manager.cc:1905] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:40:55.959842 19124 ts_tablet_manager.cc:1918] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:40:55.959983 19124 log.cc:1196] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/49ded0ed60e447aa9f7cfa34b351c9ab
I20260806 10:40:55.960700 19124 ts_tablet_manager.cc:1939] T 49ded0ed60e447aa9f7cfa34b351c9ab P 827850bebdb7400899b3008b3900c170: Deleting consensus metadata
I20260806 10:40:55.962133 18251 catalog_manager.cc:4841] TS 827850bebdb7400899b3008b3900c170 (127.16.45.66:35789): tablet 49ded0ed60e447aa9f7cfa34b351c9ab (table test-table [id=9201d53e3a51494595694e7e3227686f]) successfully deleted
I20260806 10:40:55.968825 19123 tablet_replica.cc:330] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067: stopping tablet replica
I20260806 10:40:55.969039 19123 raft_consensus.cc:2229] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:40:55.969666 19123 raft_consensus.cc:2258] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:40:55.971040 19123 ts_tablet_manager.cc:1905] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:40:55.972360 19125 ts_tablet_manager.cc:1918] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:40:55.972520 19125 log.cc:1196] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/49ded0ed60e447aa9f7cfa34b351c9ab
I20260806 10:40:55.974478 19125 ts_tablet_manager.cc:1939] T 49ded0ed60e447aa9f7cfa34b351c9ab P 180d1d1dcae54219a6d4f69b472ddfd7: Deleting consensus metadata
I20260806 10:40:55.975841 18252 catalog_manager.cc:4841] TS 180d1d1dcae54219a6d4f69b472ddfd7 (127.16.45.67:46629): tablet 49ded0ed60e447aa9f7cfa34b351c9ab (table test-table [id=9201d53e3a51494595694e7e3227686f]) successfully deleted
I20260806 10:40:55.982704 19123 ts_tablet_manager.cc:1918] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:40:55.982865 19123 log.cc:1196] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/49ded0ed60e447aa9f7cfa34b351c9ab
I20260806 10:40:55.983421 19123 ts_tablet_manager.cc:1939] T 49ded0ed60e447aa9f7cfa34b351c9ab P 9abca473091541928880c3a6324bd067: Deleting consensus metadata
I20260806 10:40:55.984604 18253 catalog_manager.cc:4841] TS 9abca473091541928880c3a6324bd067 (127.16.45.65:38731): tablet 49ded0ed60e447aa9f7cfa34b351c9ab (table test-table [id=9201d53e3a51494595694e7e3227686f]) successfully deleted
Aug 06 10:40:55 dist-test-slave-fgb3 krb5kdc[18198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012854, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:40:55.995817 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.959551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56492 (local address 127.16.45.65:38731)
0806 10:40:55.959725 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:55.959732 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:55.969054 (+ 9322us) server_negotiation.cc:407] Connection header received
0806 10:40:55.969288 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:55.969294 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:55.969597 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:55.969711 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:55.973216 (+ 3505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.974599 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.976654 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:55.977483 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:55.977586 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:55.987282 (+ 9696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:55.987296 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:55.987311 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:55.987349 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:55.991393 (+ 4044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:55.992336 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:55.992345 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:55.992348 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:55.992545 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:55.993107 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:55.993115 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:55.993118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:55.993675 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:55.994126 (+ 451us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:55.994929 (+ 803us) server_negotiation.cc:299] Negotiation successful
0806 10:40:55.995270 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260806 10:40:55.996613 18583 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56492
I20260806 10:40:56.021292 19136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:55.999786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51168 (local address 127.16.45.126:36423)
0806 10:40:56.003008 (+ 3222us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:56.003013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:56.003030 (+ 17us) server_negotiation.cc:407] Connection header received
0806 10:40:56.003079 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:56.003083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:56.003142 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:56.003227 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:56.005418 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:56.006542 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:56.008564 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:56.009219 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:56.009317 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:56.013482 (+ 4165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:56.013488 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:56.013491 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:56.013528 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:56.017528 (+ 4000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:56.018778 (+ 1250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:56.018782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:56.018785 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:56.019114 (+ 329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:56.019626 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:56.019630 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:56.019633 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:56.020031 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:56.020377 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:56.020750 (+ 373us) server_negotiation.cc:299] Negotiation successful
0806 10:40:56.020980 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3123,"thread_start_us":2848,"threads_started":1}
W20260806 10:40:56.022070 18275 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51168
I20260806 10:40:56.024444 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 18388
I20260806 10:40:56.042150 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:56.025405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56494 (local address 127.16.45.65:38731)
0806 10:40:56.025583 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:56.025589 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:56.025993 (+ 404us) server_negotiation.cc:407] Connection header received
0806 10:40:56.026159 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:56.026163 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:56.026254 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:56.026368 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:56.027546 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:56.028327 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:56.029520 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:56.030201 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:56.030347 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:56.033997 (+ 3650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:56.034002 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:56.034006 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:56.034040 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:56.038596 (+ 4556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:56.039545 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:56.039549 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:56.039551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:56.039710 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:56.040165 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:56.040169 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:56.040172 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:56.040510 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:56.040902 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:56.041313 (+ 411us) server_negotiation.cc:299] Negotiation successful
0806 10:40:56.041566 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 10:40:56.043181 18583 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56494
W20260806 10:40:56.043879 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 18388: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:40:56.044152 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 18388
I20260806 10:40:56.074292 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 18600
Aug 06 10:40:56 dist-test-slave-fgb3 krb5kdc[18198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012854, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:40:56.089438 19091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:56.075287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44224 (local address 127.16.45.66:35789)
0806 10:40:56.075500 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:56.075504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:56.075522 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:40:56.075578 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:56.075581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:56.075668 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:56.075763 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:56.077419 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:56.078136 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:56.079495 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:56.080161 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:56.080342 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:56.084486 (+ 4144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:56.084502 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:56.084518 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:56.084558 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:56.087243 (+ 2685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:56.087843 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:56.087850 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:56.087852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:56.087993 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:56.088281 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:56.088283 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:56.088285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:56.088597 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:56.088824 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:56.089034 (+ 210us) server_negotiation.cc:299] Negotiation successful
0806 10:40:56.089200 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260806 10:40:56.090324 18799 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44224
W20260806 10:40:56.091148 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 18600: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:40:56.091310 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 18600
I20260806 10:40:56.114138 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 18810
Aug 06 10:40:56 dist-test-slave-fgb3 krb5kdc[18198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012854, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:40:56.129839 19140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:56.114926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49634 (local address 127.16.45.67:46629)
0806 10:40:56.115453 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:56.115458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:56.115476 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:40:56.115532 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:56.115536 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:56.115604 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:56.115693 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:56.116987 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:56.117746 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:56.119070 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:56.119546 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:56.119644 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:56.124305 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:56.124322 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:56.124339 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:56.124391 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:56.127268 (+ 2877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:56.127993 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:56.128002 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:56.128004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:56.128155 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:56.128490 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:56.128493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:56.128495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:56.128843 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:56.129091 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:56.129366 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 10:40:56.129562 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":253,"threads_started":1}
W20260806 10:40:56.130682 18995 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49634
W20260806 10:40:56.131294 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 18810: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:40:56.131443 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 18810
I20260806 10:40:56.150292 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 18225
I20260806 10:40:56.151582 18340 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:40:56.266373 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 18225
2026-08-06T10:40:56Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5135 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:40:56 dist-test-slave-fgb3 krb5kdc[19144](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:40:56 dist-test-slave-fgb3 krb5kdc[19144](info): set up 2 sockets
Aug 06 10:40:56 dist-test-slave-fgb3 krb5kdc[19144](info): commencing operation
krb5kdc: starting...
W20260806 10:40:57.427889 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.003s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:40:57 dist-test-slave-fgb3 krb5kdc[19144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:40:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:40:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:40:57.630275 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:42097
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:45499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:42097
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:57.954172 19165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:57.954512 19165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:57.954623 19165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:57.961732 19165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:40:57.961843 19165 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 10:40:57.961892 19165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:57.961956 19165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:57.962005 19165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:40:57.962065 19165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:40:57.971971 19165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:42097
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:42097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:57.973201 19165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:57.974483 19165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:57.985844 19174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:57.985850 19176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:57.986092 19172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:57.986678 19165 server_base.cc:1034] running on GCE node
I20260806 10:40:57.987452 19165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:57.988734 19165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:57.989948 19165 hybrid_clock.cc:648] HybridClock initialized: now 1786012857989881 us; error 37 us; skew 500 ppm
I20260806 10:40:57.990259 19165 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:57 dist-test-slave-fgb3 krb5kdc[19144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012857, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:57.996707 19165 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:40:57.998148 19165 webserver.cc:460] Webserver started at http://127.16.45.126:44135/ using document root <none> and password file <none>
I20260806 10:40:57.998903 19165 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:57.999025 19165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:57.999436 19165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:58.003047 19165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "83cd0492b54344278f5c124a4e3a9965"
format_stamp: "Formatted at 2026-08-06 10:40:57 on dist-test-slave-fgb3"
server_key: "81607ad3ee6078abf62ef318acea8f1c"
server_key_iv: "004b8f894f840bb28d2a5f3760433b6d"
server_key_version: "encryptionkey@0"
I20260806 10:40:58.003785 19165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "83cd0492b54344278f5c124a4e3a9965"
format_stamp: "Formatted at 2026-08-06 10:40:57 on dist-test-slave-fgb3"
server_key: "81607ad3ee6078abf62ef318acea8f1c"
server_key_iv: "004b8f894f840bb28d2a5f3760433b6d"
server_key_version: "encryptionkey@0"
I20260806 10:40:58.008970 19165 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260806 10:40:58.012462 19188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:58.013926 19165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:40:58.014089 19165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "83cd0492b54344278f5c124a4e3a9965"
format_stamp: "Formatted at 2026-08-06 10:40:57 on dist-test-slave-fgb3"
server_key: "81607ad3ee6078abf62ef318acea8f1c"
server_key_iv: "004b8f894f840bb28d2a5f3760433b6d"
server_key_version: "encryptionkey@0"
I20260806 10:40:58.014276 19165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:58.052922 19165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:58.058872 19165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:58.059207 19165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:58.080982 19165 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:42097
I20260806 10:40:58.080989 19283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:42097 every 8 connection(s)
I20260806 10:40:58.082438 19165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:40:58.086407 19285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:58.090015 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 19165
I20260806 10:40:58.090219 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:40:58.090876 16565 external_mini_cluster.cc:1428] Setting key ab4a50f9c44a5281dc04d93286c0a536
I20260806 10:40:58.097368 19285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965: Bootstrap starting.
I20260806 10:40:58.101032 19285 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:58.102160 19285 log.cc:824] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:58.104758 19285 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965: No bootstrap required, opened a new log
Aug 06 10:40:58 dist-test-slave-fgb3 krb5kdc[19144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:58.112896 19285 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83cd0492b54344278f5c124a4e3a9965" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42097 } }
I20260806 10:40:58.113283 19285 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:58.113389 19285 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83cd0492b54344278f5c124a4e3a9965, State: Initialized, Role: FOLLOWER
I20260806 10:40:58.113926 19291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:58.092832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53240 (local address 127.16.45.126:42097)
0806 10:40:58.093590 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:58.093601 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:58.093643 (+ 42us) server_negotiation.cc:407] Connection header received
0806 10:40:58.095803 (+ 2160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:58.095830 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:58.096229 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:58.096559 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:58.098411 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:58.099709 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:58.101480 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:58.102569 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:58.102735 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:58.106582 (+ 3847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:58.106590 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:58.106604 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:58.106641 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:58.109728 (+ 3087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:58.110458 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:58.110467 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:58.110476 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:58.110639 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:58.111025 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:58.111030 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:58.111033 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:58.111618 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:58.111909 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:58.112348 (+ 439us) server_negotiation.cc:299] Negotiation successful
0806 10:40:58.112800 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":329,"threads_started":1}
I20260806 10:40:58.113960 19285 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83cd0492b54344278f5c124a4e3a9965" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42097 } }
I20260806 10:40:58.114245 19285 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:40:58.114421 19285 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:40:58.114600 19285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:58.117426 19285 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83cd0492b54344278f5c124a4e3a9965" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42097 } }
I20260806 10:40:58.117893 19285 leader_election.cc:302] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83cd0492b54344278f5c124a4e3a9965; no voters:
I20260806 10:40:58.118582 19285 leader_election.cc:288] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:40:58.118693 19293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:40:58.119424 19293 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [term 1 LEADER]: Becoming Leader. State: Replica: 83cd0492b54344278f5c124a4e3a9965, State: Running, Role: LEADER
I20260806 10:40:58.119920 19293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83cd0492b54344278f5c124a4e3a9965" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42097 } }
I20260806 10:40:58.120721 19285 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:40:58.122578 19294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83cd0492b54344278f5c124a4e3a9965" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83cd0492b54344278f5c124a4e3a9965" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42097 } } }
I20260806 10:40:58.122965 19294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [sys.catalog]: This master's current role is: LEADER
I20260806 10:40:58.124424 19303 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:40:58.124372 19296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83cd0492b54344278f5c124a4e3a9965. Latest consensus state: current_term: 1 leader_uuid: "83cd0492b54344278f5c124a4e3a9965" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83cd0492b54344278f5c124a4e3a9965" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42097 } } }
I20260806 10:40:58.124645 19296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965 [sys.catalog]: This master's current role is: LEADER
I20260806 10:40:58.129213 19303 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:40:58.137636 19303 catalog_manager.cc:1347] Generated new cluster ID: d9d5240848b1450381a970788d25d05e
I20260806 10:40:58.137758 19303 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:40:58.150161 19303 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:40:58.151472 19303 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:40:58.156718 19303 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965: Generated new TSK 0
I20260806 10:40:58.157748 19303 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:40:58.205431 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42097
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:45499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:58.530977 19321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:58.531282 19321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:58.531437 19321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:58.538651 19321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:58.538789 19321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:58.538937 19321 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 10:40:58.539011 19321 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 10:40:58.539112 19321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:40:58.548861 19321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.45.126:42097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:58.550163 19321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:58.551497 19321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:58.564226 19330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:58.564256 19329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:58.564432 19335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:58.565048 19321 server_base.cc:1034] running on GCE node
I20260806 10:40:58.565658 19321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:58.566593 19321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:58.567806 19321 hybrid_clock.cc:648] HybridClock initialized: now 1786012858567750 us; error 45 us; skew 500 ppm
I20260806 10:40:58.568094 19321 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:58 dist-test-slave-fgb3 krb5kdc[19144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012858, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:58.574610 19321 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:40:58.576193 19321 webserver.cc:460] Webserver started at http://127.16.45.65:35437/ using document root <none> and password file <none>
I20260806 10:40:58.576879 19321 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:58.576985 19321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:58.577256 19321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:58.580267 19321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "b0a8d6301cbf4c179566f746b8db38b2"
format_stamp: "Formatted at 2026-08-06 10:40:58 on dist-test-slave-fgb3"
server_key: "9a4bf26b276483f2547a8b4f1a19fd07"
server_key_iv: "defbf1f5d9f7bfe4657e95ce2b2caf95"
server_key_version: "encryptionkey@0"
I20260806 10:40:58.581005 19321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "b0a8d6301cbf4c179566f746b8db38b2"
format_stamp: "Formatted at 2026-08-06 10:40:58 on dist-test-slave-fgb3"
server_key: "9a4bf26b276483f2547a8b4f1a19fd07"
server_key_iv: "defbf1f5d9f7bfe4657e95ce2b2caf95"
server_key_version: "encryptionkey@0"
I20260806 10:40:58.586474 19321 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 10:40:58.589972 19348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:58.591351 19321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:40:58.591508 19321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "b0a8d6301cbf4c179566f746b8db38b2"
format_stamp: "Formatted at 2026-08-06 10:40:58 on dist-test-slave-fgb3"
server_key: "9a4bf26b276483f2547a8b4f1a19fd07"
server_key_iv: "defbf1f5d9f7bfe4657e95ce2b2caf95"
server_key_version: "encryptionkey@0"
I20260806 10:40:58.591701 19321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:58.610450 19321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:58.614837 19321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:58.615128 19321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:58.617937 19321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:40:58.618067 19321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:58.618203 19321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:40:58.618305 19321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 10:40:58 dist-test-slave-fgb3 krb5kdc[19144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012858, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:58.641817 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:58.618543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:34777 (local address 127.16.45.126:42097)
0806 10:40:58.619247 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:58.619253 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:58.620301 (+ 1048us) server_negotiation.cc:407] Connection header received
0806 10:40:58.622617 (+ 2316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:58.622623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:58.622726 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:58.622855 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:58.625246 (+ 2391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:58.626186 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:58.628759 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:58.629434 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:58.629580 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:58.635081 (+ 5501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:58.635087 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:58.635090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:58.635130 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:58.638077 (+ 2947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:58.639214 (+ 1137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:58.639221 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:58.639225 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:58.639397 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:58.640003 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:58.640007 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:58.640009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:58.640292 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:58.640408 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:58.641371 (+ 963us) server_negotiation.cc:299] Negotiation successful
0806 10:40:58.641551 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":440,"threads_started":1}
I20260806 10:40:58.643895 19367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:58.619168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42097 (local address 127.16.45.65:34777)
0806 10:40:58.620084 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:58.620134 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:58.622237 (+ 2103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:58.623189 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:58.623202 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:58.624061 (+ 859us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:58.625032 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:58.625068 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:58.626406 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:58.626410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:58.628582 (+ 2172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:58.628600 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:58.629915 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:58.629923 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:58.630248 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:58.631135 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:58.631182 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:58.634776 (+ 3594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:58.638241 (+ 3465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:58.638252 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:58.638275 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:58.639044 (+ 769us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:58.639532 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:58.639538 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:58.639543 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:58.639880 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:58.640416 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:58.640426 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:58.640969 (+ 543us) client_negotiation.cc:769] Sending connection context
0806 10:40:58.641311 (+ 342us) client_negotiation.cc:240] Negotiation successful
0806 10:40:58.641996 (+ 685us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":364,"threads_started":1}
I20260806 10:40:58.664958 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:58.651623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:43065 (local address 127.16.45.126:42097)
0806 10:40:58.651836 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:58.651843 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:58.652405 (+ 562us) server_negotiation.cc:407] Connection header received
0806 10:40:58.652667 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:58.652673 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:58.652773 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:58.652894 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:58.654398 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:58.655396 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:58.656718 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:58.657283 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:58.657397 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:58.659515 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:58.659522 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:58.659527 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:58.659564 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:58.662047 (+ 2483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:58.662823 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:58.662830 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:58.662833 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:58.663005 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:58.663448 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:58.663453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:58.663457 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:58.663810 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:58.663963 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:58.664348 (+ 385us) server_negotiation.cc:299] Negotiation successful
0806 10:40:58.664578 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 10:40:58.665066 19498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:58.651625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42097 (local address 127.16.45.65:43065)
0806 10:40:58.652304 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:58.652321 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:58.652469 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:58.652943 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:58.652947 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:58.653712 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:58.654172 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:58.654190 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:58.655551 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:58.655557 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:58.656584 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:58.656596 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:58.657468 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:58.657474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:58.657629 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:58.658241 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:58.658261 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:58.659305 (+ 1044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:58.662189 (+ 2884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:58.662194 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:58.662199 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:58.662678 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:58.663137 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:58.663142 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:58.663149 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:58.663324 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:58.663913 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:58.663917 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:58.664099 (+ 182us) client_negotiation.cc:769] Sending connection context
0806 10:40:58.664218 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 10:40:58.664614 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":366,"threads_started":1}
I20260806 10:40:58.666246 19321 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:38903
I20260806 10:40:58.666258 19535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:38903 every 8 connection(s)
I20260806 10:40:58.667661 19321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:40:58.668371 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 19321
I20260806 10:40:58.668562 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:40:58.669385 16565 external_mini_cluster.cc:1428] Setting key b061d8410d4ea9d87e50a1653033d72d
I20260806 10:40:58.670535 19537 heartbeater.cc:347] Connected to a master server at 127.16.45.126:42097
I20260806 10:40:58.670749 19537 heartbeater.cc:464] Registering TS with master...
I20260806 10:40:58.671444 19537 heartbeater.cc:511] Master 127.16.45.126:42097 requested a full tablet report, sending...
I20260806 10:40:58.673342 19217 ts_manager.cc:194] Registered new tserver with Master: b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65:38903)
I20260806 10:40:58.674821 19217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:34777
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:40:58.714222 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42097
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:45499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:59.034065 19541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:59.034399 19541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:59.034564 19541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:59.042172 19541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:59.042299 19541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:59.042497 19541 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 10:40:59.042577 19541 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 10:40:59.042662 19541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:40:59.052783 19541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.45.126:42097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:59.054103 19541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:59.055539 19541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:59.069068 19547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:59.069196 19552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:59.069200 19549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:59.069703 19541 server_base.cc:1034] running on GCE node
I20260806 10:40:59.070490 19541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:59.071566 19541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:59.072798 19541 hybrid_clock.cc:648] HybridClock initialized: now 1786012859072733 us; error 51 us; skew 500 ppm
I20260806 10:40:59.073150 19541 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:59 dist-test-slave-fgb3 krb5kdc[19144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012859, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:59.076561 19541 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:40:59.078150 19541 webserver.cc:460] Webserver started at http://127.16.45.66:35855/ using document root <none> and password file <none>
I20260806 10:40:59.078877 19541 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:59.079000 19541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:59.079317 19541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:59.083123 19541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "460d72b92b8d4e879f6d1f6ab27893e1"
format_stamp: "Formatted at 2026-08-06 10:40:59 on dist-test-slave-fgb3"
server_key: "d413abf069af4624f90bbea9da999179"
server_key_iv: "b3134f91434bb702e2daa4750929ebf3"
server_key_version: "encryptionkey@0"
I20260806 10:40:59.084081 19541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "460d72b92b8d4e879f6d1f6ab27893e1"
format_stamp: "Formatted at 2026-08-06 10:40:59 on dist-test-slave-fgb3"
server_key: "d413abf069af4624f90bbea9da999179"
server_key_iv: "b3134f91434bb702e2daa4750929ebf3"
server_key_version: "encryptionkey@0"
I20260806 10:40:59.090778 19541 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 10:40:59.095155 19560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:59.096829 19541 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260806 10:40:59.096995 19541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "460d72b92b8d4e879f6d1f6ab27893e1"
format_stamp: "Formatted at 2026-08-06 10:40:59 on dist-test-slave-fgb3"
server_key: "d413abf069af4624f90bbea9da999179"
server_key_iv: "b3134f91434bb702e2daa4750929ebf3"
server_key_version: "encryptionkey@0"
I20260806 10:40:59.097203 19541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:59.120780 19541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:59.124984 19541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:59.125240 19541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:59.127988 19541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:40:59.128098 19541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:59.128214 19541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:40:59.128309 19541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 10:40:59 dist-test-slave-fgb3 krb5kdc[19144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012859, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:59.152628 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.128846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:40119 (local address 127.16.45.126:42097)
0806 10:40:59.129034 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:59.129039 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:59.130720 (+ 1681us) server_negotiation.cc:407] Connection header received
0806 10:40:59.132722 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:59.132729 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:59.132841 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:59.132931 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:59.135235 (+ 2304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.136119 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.139004 (+ 2885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.139484 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.139588 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.145257 (+ 5669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:59.145264 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:59.145268 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:59.145304 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:59.148567 (+ 3263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:59.149537 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:59.149543 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:59.149547 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:59.149721 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:59.150305 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:59.150332 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:59.150336 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:59.150733 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:59.150922 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:59.152012 (+ 1090us) server_negotiation.cc:299] Negotiation successful
0806 10:40:59.152273 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 10:40:59.154596 19572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.129558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42097 (local address 127.16.45.66:40119)
0806 10:40:59.130562 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:59.130607 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:59.132445 (+ 1838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:59.133246 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:59.133270 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:59.134107 (+ 837us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:59.135016 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.135048 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.136290 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.136296 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.138834 (+ 2538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.138853 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.139739 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.139750 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.140263 (+ 513us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.141175 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:59.141223 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:59.144870 (+ 3647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:59.148756 (+ 3886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:59.148767 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:59.148787 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:59.149364 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:59.149861 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:59.149865 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:59.149867 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:59.150144 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:59.150898 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:59.150911 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:59.151513 (+ 602us) client_negotiation.cc:769] Sending connection context
0806 10:40:59.151889 (+ 376us) client_negotiation.cc:240] Negotiation successful
0806 10:40:59.152611 (+ 722us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":427,"threads_started":1}
I20260806 10:40:59.166944 19541 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:44389
I20260806 10:40:59.167047 19735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:44389 every 8 connection(s)
I20260806 10:40:59.168708 19541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:40:59.171527 19736 heartbeater.cc:347] Connected to a master server at 127.16.45.126:42097
I20260806 10:40:59.171758 19736 heartbeater.cc:464] Registering TS with master...
I20260806 10:40:59.172547 19736 heartbeater.cc:511] Master 127.16.45.126:42097 requested a full tablet report, sending...
I20260806 10:40:59.174111 19217 ts_manager.cc:194] Registered new tserver with Master: 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66:44389)
I20260806 10:40:59.174669 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 19541
I20260806 10:40:59.174855 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:40:59.175202 19217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:40119
I20260806 10:40:59.175321 16565 external_mini_cluster.cc:1428] Setting key fe3981da43856c0ed3219483f0b3bb53
I20260806 10:40:59.177320 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.162456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:44313 (local address 127.16.45.126:42097)
0806 10:40:59.162636 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:59.162641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:59.163760 (+ 1119us) server_negotiation.cc:407] Connection header received
0806 10:40:59.164075 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:59.164083 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:59.164167 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:59.164245 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:59.165621 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.166757 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.168665 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.169124 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.169259 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.171354 (+ 2095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:59.171360 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:59.171365 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:59.171409 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:59.174496 (+ 3087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:59.175250 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:59.175256 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:59.175259 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:59.175448 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:59.175902 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:59.175907 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:59.175910 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:59.176234 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:59.176377 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:59.176784 (+ 407us) server_negotiation.cc:299] Negotiation successful
0806 10:40:59.176991 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 10:40:59.177444 19716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.162638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42097 (local address 127.16.45.66:44313)
0806 10:40:59.163631 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:59.163658 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:59.163898 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:59.164489 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:59.164498 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:59.165165 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:59.165473 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.165483 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.166930 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.166938 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.168490 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.168505 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.169376 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.169384 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.169601 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.170296 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:59.170400 (+ 104us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:59.171137 (+ 737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:59.174629 (+ 3492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:59.174634 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:59.174638 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:59.175132 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:59.175593 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:59.175598 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:59.175601 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:59.175759 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:59.176356 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:59.176361 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:59.176546 (+ 185us) client_negotiation.cc:769] Sending connection context
0806 10:40:59.176675 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 10:40:59.177011 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":810,"thread_start_us":622,"threads_started":1}
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:40:59.221992 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42097
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:45499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:40:59.553586 19742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:40:59.553860 19742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:40:59.553979 19742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:40:59.561386 19742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:40:59.561504 19742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:40:59.561599 19742 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 10:40:59.561650 19742 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 10:40:59.561717 19742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:40:59.571548 19742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.45.126:42097
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:40:59.572808 19742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:40:59.574111 19742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:40:59.587142 19751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:59.587296 19754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:40:59.587641 19749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:40:59.588661 19742 server_base.cc:1034] running on GCE node
I20260806 10:40:59.589291 19742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:40:59.590178 19742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:40:59.591389 19742 hybrid_clock.cc:648] HybridClock initialized: now 1786012859591317 us; error 61 us; skew 500 ppm
I20260806 10:40:59.591693 19742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:40:59 dist-test-slave-fgb3 krb5kdc[19144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012859, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:40:59.594731 19742 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:40:59.596158 19742 webserver.cc:460] Webserver started at http://127.16.45.67:34733/ using document root <none> and password file <none>
I20260806 10:40:59.596838 19742 fs_manager.cc:359] Metadata directory not provided
I20260806 10:40:59.596957 19742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:40:59.597249 19742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:40:59.600183 19742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "712a94b41a0e4afc8924793d0f159405"
format_stamp: "Formatted at 2026-08-06 10:40:59 on dist-test-slave-fgb3"
server_key: "a833d15366f6baaa570d93d8fc5d775d"
server_key_iv: "4fc5b089c2357f73840a4a1b0590964f"
server_key_version: "encryptionkey@0"
I20260806 10:40:59.600888 19742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "712a94b41a0e4afc8924793d0f159405"
format_stamp: "Formatted at 2026-08-06 10:40:59 on dist-test-slave-fgb3"
server_key: "a833d15366f6baaa570d93d8fc5d775d"
server_key_iv: "4fc5b089c2357f73840a4a1b0590964f"
server_key_version: "encryptionkey@0"
I20260806 10:40:59.606024 19742 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 10:40:59.609417 19763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:59.610699 19742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 10:40:59.610845 19742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "712a94b41a0e4afc8924793d0f159405"
format_stamp: "Formatted at 2026-08-06 10:40:59 on dist-test-slave-fgb3"
server_key: "a833d15366f6baaa570d93d8fc5d775d"
server_key_iv: "4fc5b089c2357f73840a4a1b0590964f"
server_key_version: "encryptionkey@0"
I20260806 10:40:59.611035 19742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:40:59.626113 19742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:40:59.630584 19742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:40:59.630856 19742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:40:59.633508 19742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:40:59.633630 19742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:40:59.633744 19742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:40:59.633843 19742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 10:40:59 dist-test-slave-fgb3 krb5kdc[19144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012859, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:59.656984 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.634217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:42911 (local address 127.16.45.126:42097)
0806 10:40:59.634439 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:59.634446 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:59.635987 (+ 1541us) server_negotiation.cc:407] Connection header received
0806 10:40:59.638295 (+ 2308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:59.638301 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:59.638436 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:59.638499 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:59.641035 (+ 2536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.642079 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.644619 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.645157 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.645280 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.649649 (+ 4369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:59.649656 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:59.649662 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:59.649709 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:59.652976 (+ 3267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:59.653952 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:59.653958 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:59.653961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:59.654124 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:59.654803 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:59.654808 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:59.654811 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:59.655144 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:59.655299 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:59.656255 (+ 956us) server_negotiation.cc:299] Negotiation successful
0806 10:40:59.656548 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 10:40:59.657773 19786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.634945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42097 (local address 127.16.45.67:42911)
0806 10:40:59.635798 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:59.635845 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:59.637904 (+ 2059us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:59.639066 (+ 1162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:59.639074 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:59.639853 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:59.640780 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.640801 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.642252 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.642256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.644453 (+ 2197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.644466 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.645423 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.645436 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.645663 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.646503 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:59.646526 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:59.649376 (+ 2850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:59.653159 (+ 3783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:59.653168 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:59.653192 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:59.653813 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:59.654276 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:59.654281 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:59.654285 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:59.654653 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:59.655393 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:59.655401 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:59.655824 (+ 423us) client_negotiation.cc:769] Sending connection context
0806 10:40:59.656054 (+ 230us) client_negotiation.cc:240] Negotiation successful
0806 10:40:59.656473 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":398,"threads_started":1}
I20260806 10:40:59.677448 19537 heartbeater.cc:503] Master 127.16.45.126:42097 was elected leader, sending a full tablet report...
I20260806 10:40:59.682896 19742 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:37103
I20260806 10:40:59.683053 19951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:37103 every 8 connection(s)
I20260806 10:40:59.683709 19895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.663760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42097 (local address 127.16.45.67:45677)
0806 10:40:59.669501 (+ 5741us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:59.669520 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:59.669672 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:59.670187 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:59.670193 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:59.670833 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:40:59.671312 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.671327 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.672817 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.672822 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.674107 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.674120 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.675121 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.675130 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.675261 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.675885 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:40:59.675921 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:40:59.677038 (+ 1117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:40:59.680891 (+ 3853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:59.680896 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:59.680900 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:59.681282 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:59.681708 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:40:59.681712 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:40:59.681715 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:40:59.681885 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:40:59.682598 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:40:59.682602 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:40:59.682842 (+ 240us) client_negotiation.cc:769] Sending connection context
0806 10:40:59.683020 (+ 178us) client_negotiation.cc:240] Negotiation successful
0806 10:40:59.683385 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5585,"thread_start_us":5447,"threads_started":1}
I20260806 10:40:59.683758 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.663708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:45677 (local address 127.16.45.126:42097)
0806 10:40:59.663905 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:59.663911 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:59.669624 (+ 5713us) server_negotiation.cc:407] Connection header received
0806 10:40:59.669796 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:59.669802 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:59.669903 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:59.670003 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:59.671514 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.672623 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.674247 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.674734 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.674868 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.677239 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:59.677245 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:59.677249 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:59.677290 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:59.680773 (+ 3483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:59.681394 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:59.681400 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:59.681404 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:59.681577 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:59.682023 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:59.682030 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:59.682034 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:59.682473 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:59.682655 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:59.683175 (+ 520us) server_negotiation.cc:299] Negotiation successful
0806 10:40:59.683426 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 10:40:59.684543 19742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:40:59.686676 19952 heartbeater.cc:347] Connected to a master server at 127.16.45.126:42097
I20260806 10:40:59.686939 19952 heartbeater.cc:464] Registering TS with master...
I20260806 10:40:59.687633 19952 heartbeater.cc:511] Master 127.16.45.126:42097 requested a full tablet report, sending...
I20260806 10:40:59.688922 19217 ts_manager.cc:194] Registered new tserver with Master: 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103)
I20260806 10:40:59.689716 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 19742
I20260806 10:40:59.689719 19217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:42911
I20260806 10:40:59.689882 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:40:59.690454 16565 external_mini_cluster.cc:1428] Setting key 8219fb794cdc90807d27b9f2d6775d77
I20260806 10:40:59.693292 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 10:40:59 dist-test-slave-fgb3 krb5kdc[19144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 10:40:59 dist-test-slave-fgb3 krb5kdc[19144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:40:59.742242 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.728904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53248 (local address 127.16.45.126:42097)
0806 10:40:59.729136 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:59.729142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:59.729411 (+ 269us) server_negotiation.cc:407] Connection header received
0806 10:40:59.729567 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:59.729571 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:59.729636 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:59.729719 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:40:59.731179 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.731985 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.733157 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.733621 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.733742 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.737438 (+ 3696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:40:59.737443 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:40:59.737446 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:40:59.737482 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:40:59.739987 (+ 2505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:59.740566 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:59.740569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:59.740571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:59.740687 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:40:59.740975 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:40:59.740978 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:40:59.740980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:40:59.741299 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:40:59.741487 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:59.741726 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 10:40:59.741909 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 10:40:59.746074 19217 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53248:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:40:59.752867 19217 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:40:59.792032 19981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.764805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43238 (local address 127.16.45.66:44389)
0806 10:40:59.784646 (+ 19841us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:59.784655 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:59.784681 (+ 26us) server_negotiation.cc:407] Connection header received
0806 10:40:59.784788 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:59.784794 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:59.785000 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:59.785188 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:59.786162 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.787492 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.789972 (+ 2480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.790926 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.791055 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.791284 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:59.791561 (+ 277us) server_negotiation.cc:299] Negotiation successful
0806 10:40:59.791732 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19681,"thread_start_us":20766,"threads_started":1}
I20260806 10:40:59.792474 19976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.764605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:44389 (local address 127.0.0.1:43238)
0806 10:40:59.780717 (+ 16112us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:59.780772 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:59.781030 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:59.785445 (+ 4415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:59.785450 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:59.785475 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:59.785977 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.785992 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.787645 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.787650 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.789837 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.789847 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.791128 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.791135 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.791331 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.791377 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 10:40:59.791490 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 10:40:59.791703 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15754,"mutex_wait_us":3,"thread_start_us":15592,"threads_started":1}
I20260806 10:40:59.792634 19983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.765018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52110 (local address 127.16.45.65:38903)
0806 10:40:59.783575 (+ 18557us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:59.783583 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:59.783616 (+ 33us) server_negotiation.cc:407] Connection header received
0806 10:40:59.784094 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:59.784104 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:59.784390 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:59.784605 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:59.785464 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.786987 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.789783 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.791198 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.791321 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.791519 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:59.792174 (+ 655us) server_negotiation.cc:299] Negotiation successful
0806 10:40:59.792354 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18391,"thread_start_us":18231,"threads_started":1}
I20260806 10:40:59.792598 19977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.766082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:37103 (local address 127.0.0.1:47046)
0806 10:40:59.783988 (+ 17906us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:59.784008 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:59.784154 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:59.784698 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:59.784705 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:59.784736 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:59.785787 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.785801 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.787383 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.787388 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.789535 (+ 2147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.789548 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.791734 (+ 2186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.791742 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.791965 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.791990 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 10:40:59.792061 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 10:40:59.792207 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17765,"mutex_wait_us":464,"thread_start_us":16426,"threads_started":1}
I20260806 10:40:59.793269 19984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.764683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38903 (local address 127.0.0.1:52110)
0806 10:40:59.782802 (+ 18119us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:59.782824 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:59.782969 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:59.784835 (+ 1866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:59.784839 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:59.784863 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:59.785299 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.785313 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.787131 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.787136 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.789643 (+ 2507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.789658 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.791687 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.791695 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.791873 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.791967 (+ 94us) client_negotiation.cc:769] Sending connection context
0806 10:40:59.792059 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 10:40:59.792908 (+ 849us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17983,"mutex_wait_us":746,"thread_start_us":18983,"threads_started":1}
I20260806 10:40:59.793702 19985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.766829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47046 (local address 127.16.45.67:37103)
0806 10:40:59.783100 (+ 16271us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:59.783110 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:59.784132 (+ 1022us) server_negotiation.cc:407] Connection header received
0806 10:40:59.784278 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:59.784284 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:59.784473 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:59.785099 (+ 626us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:59.786062 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.787240 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.789692 (+ 2452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.791198 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.791321 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.791541 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:59.792739 (+ 1198us) server_negotiation.cc:299] Negotiation successful
0806 10:40:59.792901 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15314,"thread_start_us":15122,"threads_started":1}
I20260806 10:40:59.797008 19846 tablet_service.cc:1467] Processing CreateTablet for tablet 6110a10313da4bfc90f9eff7c1eb4019 (DEFAULT_TABLE table=test-table [id=f1509074fc364810ac85aa3e84a115f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:40:59.797024 19427 tablet_service.cc:1467] Processing CreateTablet for tablet 6110a10313da4bfc90f9eff7c1eb4019 (DEFAULT_TABLE table=test-table [id=f1509074fc364810ac85aa3e84a115f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:40:59.797024 19636 tablet_service.cc:1467] Processing CreateTablet for tablet 6110a10313da4bfc90f9eff7c1eb4019 (DEFAULT_TABLE table=test-table [id=f1509074fc364810ac85aa3e84a115f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:40:59.798472 19427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6110a10313da4bfc90f9eff7c1eb4019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:59.798478 19846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6110a10313da4bfc90f9eff7c1eb4019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:59.798854 19636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6110a10313da4bfc90f9eff7c1eb4019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:40:59.810127 19986 tablet_bootstrap.cc:492] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405: Bootstrap starting.
I20260806 10:40:59.813519 19990 tablet_bootstrap.cc:492] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1: Bootstrap starting.
I20260806 10:40:59.813885 19986 tablet_bootstrap.cc:654] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:59.815201 19986 log.cc:824] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:59.817345 19990 tablet_bootstrap.cc:654] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:59.818418 19988 tablet_bootstrap.cc:492] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2: Bootstrap starting.
I20260806 10:40:59.818634 19986 tablet_bootstrap.cc:492] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405: No bootstrap required, opened a new log
I20260806 10:40:59.818712 19990 log.cc:824] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:59.818928 19986 ts_tablet_manager.cc:1397] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260806 10:40:59.821797 19988 tablet_bootstrap.cc:654] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2: Neither blocks nor log segments found. Creating new log.
I20260806 10:40:59.821871 19990 tablet_bootstrap.cc:492] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1: No bootstrap required, opened a new log
I20260806 10:40:59.822132 19990 ts_tablet_manager.cc:1397] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 10:40:59.822926 19988 log.cc:824] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2: Log is configured to *not* fsync() on all Append() calls
I20260806 10:40:59.825385 19988 tablet_bootstrap.cc:492] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2: No bootstrap required, opened a new log
I20260806 10:40:59.825642 19988 ts_tablet_manager.cc:1397] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260806 10:40:59.829530 19986 raft_consensus.cc:348] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:40:59.829999 19986 raft_consensus.cc:374] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:59.830107 19986 raft_consensus.cc:729] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712a94b41a0e4afc8924793d0f159405, State: Initialized, Role: FOLLOWER
I20260806 10:40:59.830868 19986 consensus_queue.cc:260] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:40:59.832453 19990 raft_consensus.cc:348] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:40:59.832916 19990 raft_consensus.cc:374] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:59.833024 19990 raft_consensus.cc:729] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 460d72b92b8d4e879f6d1f6ab27893e1, State: Initialized, Role: FOLLOWER
I20260806 10:40:59.833376 19988 raft_consensus.cc:348] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:40:59.833720 19988 raft_consensus.cc:374] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:40:59.833824 19988 raft_consensus.cc:729] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0a8d6301cbf4c179566f746b8db38b2, State: Initialized, Role: FOLLOWER
I20260806 10:40:59.833681 19990 consensus_queue.cc:260] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:40:59.834393 19988 consensus_queue.cc:260] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:40:59.834900 19736 heartbeater.cc:503] Master 127.16.45.126:42097 was elected leader, sending a full tablet report...
I20260806 10:40:59.835608 19990 ts_tablet_manager.cc:1428] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260806 10:40:59.838711 19952 heartbeater.cc:503] Master 127.16.45.126:42097 was elected leader, sending a full tablet report...
I20260806 10:40:59.839732 19986 ts_tablet_manager.cc:1428] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405: Time spent starting tablet: real 0.021s user 0.014s sys 0.004s
I20260806 10:40:59.841105 19988 ts_tablet_manager.cc:1428] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
W20260806 10:40:59.920776 19737 tablet.cc:2369] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:40:59.920770 19538 tablet.cc:2369] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:40:59.936175 19954 tablet.cc:2369] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:40:59.977938 19998 raft_consensus.cc:482] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:40:59.978293 19998 raft_consensus.cc:504] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:40:59.980015 19998 leader_election.cc:288] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66:44389), 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103)
I20260806 10:40:59.986573 19985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.980657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:43509 (local address 127.16.45.67:37103)
0806 10:40:59.980883 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:59.980889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:59.981487 (+ 598us) server_negotiation.cc:407] Connection header received
0806 10:40:59.981641 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:59.981645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:59.981705 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:59.981779 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:59.982414 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.983099 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.984904 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.985655 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.985800 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.985873 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:59.986180 (+ 307us) server_negotiation.cc:299] Negotiation successful
0806 10:40:59.986301 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 10:40:59.986591 19981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.980399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:42977 (local address 127.16.45.66:44389)
0806 10:40:59.980649 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 10:40:59.980657 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:40:59.981273 (+ 616us) server_negotiation.cc:407] Connection header received
0806 10:40:59.981472 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:40:59.981478 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:40:59.981541 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:40:59.981615 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:40:59.982341 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.983056 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.984943 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.985687 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.985832 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.985903 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 10:40:59.986200 (+ 297us) server_negotiation.cc:299] Negotiation successful
0806 10:40:59.986346 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 10:40:59.986688 20001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.980279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:37103 (local address 127.16.45.65:43509)
0806 10:40:59.981374 (+ 1095us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:59.981388 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:59.981515 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:59.981816 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:59.981828 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:59.981857 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:59.982247 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.982256 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.983239 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.983243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.984751 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.984763 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.985870 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.985879 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.986017 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.986054 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 10:40:59.986135 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 10:40:59.986266 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":976,"mutex_wait_us":214,"thread_start_us":580,"threads_started":1}
I20260806 10:40:59.987073 20000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:40:59.980266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:44389 (local address 127.16.45.65:42977)
0806 10:40:59.981158 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0806 10:40:59.981179 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:40:59.981334 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:40:59.981652 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:40:59.981655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:40:59.981680 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:40:59.982159 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.982177 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.983186 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.983191 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.984791 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:40:59.984803 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:40:59.985900 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:40:59.985906 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:40:59.986060 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:40:59.986082 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 10:40:59.986158 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 10:40:59.986279 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"mutex_wait_us":32,"thread_start_us":536,"threads_started":1}
I20260806 10:40:59.987666 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6110a10313da4bfc90f9eff7c1eb4019" candidate_uuid: "b0a8d6301cbf4c179566f746b8db38b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712a94b41a0e4afc8924793d0f159405" is_pre_election: true
I20260806 10:40:59.987903 19665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6110a10313da4bfc90f9eff7c1eb4019" candidate_uuid: "b0a8d6301cbf4c179566f746b8db38b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" is_pre_election: true
I20260806 10:40:59.988144 19883 raft_consensus.cc:2454] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0a8d6301cbf4c179566f746b8db38b2 in term 0.
I20260806 10:40:59.988382 19665 raft_consensus.cc:2454] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0a8d6301cbf4c179566f746b8db38b2 in term 0.
I20260806 10:40:59.988794 19354 leader_election.cc:302] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712a94b41a0e4afc8924793d0f159405, b0a8d6301cbf4c179566f746b8db38b2; no voters:
I20260806 10:40:59.989166 19998 raft_consensus.cc:2781] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:40:59.989292 19998 raft_consensus.cc:482] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:40:59.989387 19998 raft_consensus.cc:3037] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:59.991634 19998 raft_consensus.cc:504] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:40:59.992190 19998 leader_election.cc:288] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [CANDIDATE]: Term 1 election: Requested vote from peers 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66:44389), 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103)
I20260806 10:40:59.992614 19665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6110a10313da4bfc90f9eff7c1eb4019" candidate_uuid: "b0a8d6301cbf4c179566f746b8db38b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "460d72b92b8d4e879f6d1f6ab27893e1"
I20260806 10:40:59.992631 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6110a10313da4bfc90f9eff7c1eb4019" candidate_uuid: "b0a8d6301cbf4c179566f746b8db38b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712a94b41a0e4afc8924793d0f159405"
I20260806 10:40:59.992794 19665 raft_consensus.cc:3037] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:59.992797 19883 raft_consensus.cc:3037] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:40:59.995033 19883 raft_consensus.cc:2454] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0a8d6301cbf4c179566f746b8db38b2 in term 1.
I20260806 10:40:59.995047 19665 raft_consensus.cc:2454] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0a8d6301cbf4c179566f746b8db38b2 in term 1.
I20260806 10:40:59.995409 19354 leader_election.cc:302] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 712a94b41a0e4afc8924793d0f159405, b0a8d6301cbf4c179566f746b8db38b2; no voters:
I20260806 10:40:59.995664 19998 raft_consensus.cc:2781] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:40:59.996083 19998 raft_consensus.cc:686] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 1 LEADER]: Becoming Leader. State: Replica: b0a8d6301cbf4c179566f746b8db38b2, State: Running, Role: LEADER
I20260806 10:40:59.996579 19998 consensus_queue.cc:237] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.001073 19215 catalog_manager.cc:5495] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65). New cstate: current_term: 1 leader_uuid: "b0a8d6301cbf4c179566f746b8db38b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } health_report { overall_health: UNKNOWN } } }
Aug 06 10:41:00 dist-test-slave-fgb3 krb5kdc[19144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012857, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:00.058074 19366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.044962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53264 (local address 127.16.45.126:42097)
0806 10:41:00.045150 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:00.045155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:00.045684 (+ 529us) server_negotiation.cc:407] Connection header received
0806 10:41:00.045828 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:00.045832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:00.045919 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:00.046007 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:00.047296 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.048050 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.049294 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.049688 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.049779 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.052980 (+ 3201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:00.052985 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:00.052988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:00.053016 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:00.055341 (+ 2325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:00.056001 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:00.056005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:00.056007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:00.056128 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:00.056476 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:00.056480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:00.056482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:00.056777 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:00.056880 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:00.057486 (+ 606us) server_negotiation.cc:299] Negotiation successful
0806 10:41:00.057752 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":63}
I20260806 10:41:00.058118 20011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.044962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42097 (local address 127.0.0.1:53264)
0806 10:41:00.045575 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:00.045591 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:00.045730 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:00.046069 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:00.046073 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:00.046854 (+ 781us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:00.047116 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:00.047129 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.048183 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.048188 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:00.049177 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:00.049188 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.049852 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.049857 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:00.049969 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.050658 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:00.050677 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:00.052802 (+ 2125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:00.055464 (+ 2662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:00.055475 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:00.055481 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:00.055903 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:00.056226 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:00.056230 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:00.056232 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:00.056375 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:00.056931 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:00.056938 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:00.057121 (+ 183us) client_negotiation.cc:769] Sending connection context
0806 10:41:00.057377 (+ 256us) client_negotiation.cc:240] Negotiation successful
0806 10:41:00.057631 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":348,"threads_started":1}
I20260806 10:41:00.063512 19215 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:53264:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 10:41:00.064574 19215 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:00.071203 19636 tablet_service.cc:1467] Processing CreateTablet for tablet 756774b5e2ed43c086f2b9f1b458a33c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2e3dc3d1e173404d828640704af5797b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 10:41:00.070991 19427 tablet_service.cc:1467] Processing CreateTablet for tablet 756774b5e2ed43c086f2b9f1b458a33c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2e3dc3d1e173404d828640704af5797b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 10:41:00.071331 19846 tablet_service.cc:1467] Processing CreateTablet for tablet 756774b5e2ed43c086f2b9f1b458a33c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2e3dc3d1e173404d828640704af5797b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 10:41:00.072055 19636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 756774b5e2ed43c086f2b9f1b458a33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:00.072059 19427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 756774b5e2ed43c086f2b9f1b458a33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:00.072113 19846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 756774b5e2ed43c086f2b9f1b458a33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:00.077250 19986 tablet_bootstrap.cc:492] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405: Bootstrap starting.
I20260806 10:41:00.078678 19986 tablet_bootstrap.cc:654] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:00.079103 19990 tablet_bootstrap.cc:492] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: Bootstrap starting.
I20260806 10:41:00.079103 19988 tablet_bootstrap.cc:492] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2: Bootstrap starting.
I20260806 10:41:00.080734 19990 tablet_bootstrap.cc:654] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:00.080734 19988 tablet_bootstrap.cc:654] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:00.082012 19986 tablet_bootstrap.cc:492] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405: No bootstrap required, opened a new log
I20260806 10:41:00.082192 19986 ts_tablet_manager.cc:1397] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 10:41:00.082976 19986 raft_consensus.cc:348] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.083304 19986 raft_consensus.cc:374] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:00.083418 19986 raft_consensus.cc:729] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712a94b41a0e4afc8924793d0f159405, State: Initialized, Role: FOLLOWER
I20260806 10:41:00.083715 19986 consensus_queue.cc:260] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.084200 19996 tablet_replica.cc:439] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } } }
I20260806 10:41:00.084549 19996 tablet_replica.cc:442] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:00.085044 19986 ts_tablet_manager.cc:1428] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260806 10:41:00.092162 19988 tablet_bootstrap.cc:492] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2: No bootstrap required, opened a new log
I20260806 10:41:00.092320 19988 ts_tablet_manager.cc:1397] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260806 10:41:00.092970 19990 tablet_bootstrap.cc:492] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: No bootstrap required, opened a new log
I20260806 10:41:00.093129 19990 ts_tablet_manager.cc:1397] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.004s
I20260806 10:41:00.093178 19988 raft_consensus.cc:348] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.093425 19988 raft_consensus.cc:374] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:00.093520 19988 raft_consensus.cc:729] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0a8d6301cbf4c179566f746b8db38b2, State: Initialized, Role: FOLLOWER
I20260806 10:41:00.093786 19988 consensus_queue.cc:260] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.094271 19998 tablet_replica.cc:439] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } } }
I20260806 10:41:00.094478 19988 ts_tablet_manager.cc:1428] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 10:41:00.093909 19990 raft_consensus.cc:348] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.094620 19998 tablet_replica.cc:442] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:00.094677 19990 raft_consensus.cc:374] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:00.094854 19990 raft_consensus.cc:729] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 460d72b92b8d4e879f6d1f6ab27893e1, State: Initialized, Role: FOLLOWER
I20260806 10:41:00.095131 19990 consensus_queue.cc:260] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.095597 19997 tablet_replica.cc:439] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } } }
I20260806 10:41:00.095969 19997 tablet_replica.cc:442] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:00.098248 19990 ts_tablet_manager.cc:1428] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260806 10:41:00.466591 19997 raft_consensus.cc:482] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:00.466840 19997 raft_consensus.cc:504] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.468518 19997 leader_election.cc:288] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65:38903), 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103)
I20260806 10:41:00.475380 19985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.468939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:51113 (local address 127.16.45.67:37103)
0806 10:41:00.469119 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:00.469125 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:00.470082 (+ 957us) server_negotiation.cc:407] Connection header received
0806 10:41:00.470223 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:00.470227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:00.470290 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:00.470405 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:00.471134 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.471828 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.473650 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.474384 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.474507 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.474578 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:00.475000 (+ 422us) server_negotiation.cc:299] Negotiation successful
0806 10:41:00.475130 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:41:00.475529 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.468903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:41295 (local address 127.16.45.65:38903)
0806 10:41:00.470142 (+ 1239us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:00.470148 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:00.470168 (+ 20us) server_negotiation.cc:407] Connection header received
0806 10:41:00.470238 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:00.470242 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:00.470331 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:00.470423 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:00.471014 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.471808 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.473647 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.474460 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.474619 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.474690 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:00.475024 (+ 334us) server_negotiation.cc:299] Negotiation successful
0806 10:41:00.475167 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1119,"thread_start_us":1007,"threads_started":1}
I20260806 10:41:00.475601 20023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.468938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38903 (local address 127.16.45.66:41295)
0806 10:41:00.469517 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:00.469537 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:00.469691 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:00.470463 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:00.470468 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:00.470508 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:00.470832 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:00.470845 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.471963 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.471966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:00.473494 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:00.473506 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.474681 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.474686 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:00.474850 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.474892 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 10:41:00.474983 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 10:41:00.475110 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"mutex_wait_us":66,"thread_start_us":316,"threads_started":1}
I20260806 10:41:00.475622 20025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.468980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:37103 (local address 127.16.45.66:51113)
0806 10:41:00.469968 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:00.469989 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:00.470113 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:00.470448 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:00.470453 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:00.470557 (+ 104us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:00.470967 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:00.470980 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.471954 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.471958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:00.473497 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:00.473510 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.474608 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.474614 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:00.474837 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.474876 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 10:41:00.474949 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 10:41:00.475074 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":854,"mutex_wait_us":27,"spinlock_wait_cycles":27136,"thread_start_us":631,"threads_started":1}
I20260806 10:41:00.476503 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "756774b5e2ed43c086f2b9f1b458a33c" candidate_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712a94b41a0e4afc8924793d0f159405" is_pre_election: true
I20260806 10:41:00.476608 19454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "756774b5e2ed43c086f2b9f1b458a33c" candidate_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0a8d6301cbf4c179566f746b8db38b2" is_pre_election: true
I20260806 10:41:00.476733 19883 raft_consensus.cc:2454] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 460d72b92b8d4e879f6d1f6ab27893e1 in term 0.
I20260806 10:41:00.476984 19454 raft_consensus.cc:2454] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 460d72b92b8d4e879f6d1f6ab27893e1 in term 0.
I20260806 10:41:00.477178 19565 leader_election.cc:302] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 460d72b92b8d4e879f6d1f6ab27893e1, 712a94b41a0e4afc8924793d0f159405; no voters:
I20260806 10:41:00.477574 19997 raft_consensus.cc:2781] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:00.477696 19997 raft_consensus.cc:482] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:00.477787 19997 raft_consensus.cc:3037] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:00.479996 19997 raft_consensus.cc:504] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.480587 19997 leader_election.cc:288] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [CANDIDATE]: Term 1 election: Requested vote from peers b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65:38903), 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103)
I20260806 10:41:00.481009 19454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "756774b5e2ed43c086f2b9f1b458a33c" candidate_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0a8d6301cbf4c179566f746b8db38b2"
I20260806 10:41:00.481024 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "756774b5e2ed43c086f2b9f1b458a33c" candidate_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712a94b41a0e4afc8924793d0f159405"
I20260806 10:41:00.481187 19454 raft_consensus.cc:3037] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:00.481197 19883 raft_consensus.cc:3037] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:00.483114 19883 raft_consensus.cc:2454] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 460d72b92b8d4e879f6d1f6ab27893e1 in term 1.
I20260806 10:41:00.483321 19454 raft_consensus.cc:2454] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 460d72b92b8d4e879f6d1f6ab27893e1 in term 1.
I20260806 10:41:00.483470 19565 leader_election.cc:302] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 460d72b92b8d4e879f6d1f6ab27893e1, 712a94b41a0e4afc8924793d0f159405; no voters:
I20260806 10:41:00.483753 19997 raft_consensus.cc:2781] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:00.484180 19997 raft_consensus.cc:686] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 LEADER]: Becoming Leader. State: Replica: 460d72b92b8d4e879f6d1f6ab27893e1, State: Running, Role: LEADER
I20260806 10:41:00.484719 19997 consensus_queue.cc:237] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.487983 20026 tablet_replica.cc:439] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: TxnStatusTablet state changed. Reason: New leader 460d72b92b8d4e879f6d1f6ab27893e1. Latest consensus state: current_term: 1 leader_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } } }
I20260806 10:41:00.488260 20026 tablet_replica.cc:442] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: This TxnStatusTablet replica's current role is: LEADER
I20260806 10:41:00.488785 20029 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 10:41:00.489008 20029 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 10:41:00.489254 19217 catalog_manager.cc:5495] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66). New cstate: current_term: 1 leader_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260806 10:41:00.546885 20037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.539931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43252 (local address 127.16.45.66:44389)
0806 10:41:00.540600 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:00.540604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:00.540625 (+ 21us) server_negotiation.cc:407] Connection header received
0806 10:41:00.540705 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:00.540709 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:00.540794 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:00.540936 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:00.541379 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.542222 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.544201 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.544752 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.544873 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.545518 (+ 645us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:00.546147 (+ 629us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:00.546270 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:00.546450 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 10:41:00.546543 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":375,"threads_started":1}
I20260806 10:41:00.546895 20011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.539792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:44389 (local address 127.0.0.1:43252)
0806 10:41:00.540015 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:00.540036 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:00.540173 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:00.540990 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:00.540996 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:00.541009 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 10:41:00.541217 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:00.541227 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.542392 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.542398 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:00.544024 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:00.544041 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.544943 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.544950 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:00.545166 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.545266 (+ 100us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 10:41:00.546251 (+ 985us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 10:41:00.546301 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 10:41:00.546412 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 10:41:00.546577 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 10:41:00.555591 19454 raft_consensus.cc:1261] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Refusing update from remote peer 460d72b92b8d4e879f6d1f6ab27893e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:00.555672 19883 raft_consensus.cc:1261] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Refusing update from remote peer 460d72b92b8d4e879f6d1f6ab27893e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:00.556352 19998 consensus_queue.cc:1035] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:00.556501 19997 consensus_queue.cc:1035] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:00.556983 20026 consensus_queue.cc:1035] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:00.587598 19996 tablet_replica.cc:439] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405: TxnStatusTablet state changed. Reason: New leader 460d72b92b8d4e879f6d1f6ab27893e1. Latest consensus state: current_term: 1 leader_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } } }
I20260806 10:41:00.587886 19996 tablet_replica.cc:442] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:00.594009 19998 tablet_replica.cc:439] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2: TxnStatusTablet state changed. Reason: New leader 460d72b92b8d4e879f6d1f6ab27893e1. Latest consensus state: current_term: 1 leader_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } } }
I20260806 10:41:00.594337 19998 tablet_replica.cc:442] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:00.604880 20026 tablet_replica.cc:439] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } } }
I20260806 10:41:00.605195 20026 tablet_replica.cc:442] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: This TxnStatusTablet replica's current role is: LEADER
I20260806 10:41:00.607931 20051 consensus_queue.cc:1035] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:00.616842 19996 tablet_replica.cc:439] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } } }
I20260806 10:41:00.617132 19996 tablet_replica.cc:442] T 756774b5e2ed43c086f2b9f1b458a33c P 712a94b41a0e4afc8924793d0f159405: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:00.621372 19997 tablet_replica.cc:439] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } } }
I20260806 10:41:00.621800 19997 tablet_replica.cc:442] T 756774b5e2ed43c086f2b9f1b458a33c P 460d72b92b8d4e879f6d1f6ab27893e1: This TxnStatusTablet replica's current role is: LEADER
I20260806 10:41:00.625710 19998 tablet_replica.cc:439] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } } }
I20260806 10:41:00.625988 19998 tablet_replica.cc:442] T 756774b5e2ed43c086f2b9f1b458a33c P b0a8d6301cbf4c179566f746b8db38b2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:00.634665 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.624934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52114 (local address 127.16.45.65:38903)
0806 10:41:00.625130 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:00.625139 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:00.628013 (+ 2874us) server_negotiation.cc:407] Connection header received
0806 10:41:00.628436 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:00.628441 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:00.628544 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:00.628673 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:00.629211 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.630298 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.632245 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.632887 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.633012 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.633354 (+ 342us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:00.634065 (+ 711us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:00.634211 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:00.634257 (+ 46us) server_negotiation.cc:299] Negotiation successful
0806 10:41:00.634372 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 10:41:00.650595 20037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.645495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:40661 (local address 127.16.45.66:44389)
0806 10:41:00.645679 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:00.645685 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:00.645996 (+ 311us) server_negotiation.cc:407] Connection header received
0806 10:41:00.646174 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:00.646181 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:00.646248 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:00.646366 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:00.646865 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.647623 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.648941 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.649350 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.649468 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.649883 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:00.649989 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:00.650063 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:00.650201 (+ 138us) server_negotiation.cc:299] Negotiation successful
0806 10:41:00.650280 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 10:41:00.650710 20068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.645252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:44389 (local address 127.16.45.65:40661)
0806 10:41:00.645897 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:00.645917 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:00.646068 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:00.646388 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:00.646393 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:00.646407 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 10:41:00.646682 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:00.646695 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.647754 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.647760 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:00.648802 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:00.648815 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.649493 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.649499 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:00.649641 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.649694 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 10:41:00.650080 (+ 386us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 10:41:00.650092 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 10:41:00.650159 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 10:41:00.650288 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":269,"threads_started":1}
I20260806 10:41:00.708524 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.697428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:34889 (local address 127.16.45.65:38903)
0806 10:41:00.697612 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:00.697618 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:00.700483 (+ 2865us) server_negotiation.cc:407] Connection header received
0806 10:41:00.700798 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:00.700804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:00.700887 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:00.700945 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:00.701715 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.702964 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.706459 (+ 3495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.707087 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.707228 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.707752 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:00.707887 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:00.707978 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:00.708113 (+ 135us) server_negotiation.cc:299] Negotiation successful
0806 10:41:00.708198 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 10:41:00.708644 20071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:00.696948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38903 (local address 127.16.45.66:34889)
0806 10:41:00.700364 (+ 3416us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:00.700386 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:00.700620 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:00.701130 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:00.701135 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:00.701147 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 10:41:00.701519 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:00.701532 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.704555 (+ 3023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.704561 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:00.706292 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:00.706308 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:00.707300 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:00.707306 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:00.707502 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:00.707578 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 10:41:00.707993 (+ 415us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 10:41:00.708004 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 10:41:00.708078 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 10:41:00.708236 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3178,"thread_start_us":2979,"threads_started":1}
I20260806 10:41:00.755708 19217 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:00.756037 19217 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:00.760331 19217 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965: Sending DeleteTablet for 3 replicas of tablet 6110a10313da4bfc90f9eff7c1eb4019
I20260806 10:41:00.761632 19427 tablet_service.cc:1514] Processing DeleteTablet for tablet 6110a10313da4bfc90f9eff7c1eb4019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:00 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:52110
I20260806 10:41:00.762379 19846 tablet_service.cc:1514] Processing DeleteTablet for tablet 6110a10313da4bfc90f9eff7c1eb4019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:00 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:47046
I20260806 10:41:00.762753 20074 tablet_replica.cc:330] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2: stopping tablet replica
I20260806 10:41:00.763284 20074 raft_consensus.cc:2229] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:41:00.763736 19636 tablet_service.cc:1514] Processing DeleteTablet for tablet 6110a10313da4bfc90f9eff7c1eb4019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:00 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:43238
I20260806 10:41:00.764134 20074 raft_consensus.cc:2258] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:00.766168 20074 ts_tablet_manager.cc:1905] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:00.767676 19217 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53248:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:41:00.768417 19217 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:00.775005 20074 ts_tablet_manager.cc:1918] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:41:00.775381 20074 log.cc:1196] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/6110a10313da4bfc90f9eff7c1eb4019
I20260806 10:41:00.776067 20074 ts_tablet_manager.cc:1939] T 6110a10313da4bfc90f9eff7c1eb4019 P b0a8d6301cbf4c179566f746b8db38b2: Deleting consensus metadata
I20260806 10:41:00.776908 19843 tablet_service.cc:1467] Processing CreateTablet for tablet 50bad42d8a974c01a5a3670adfeab173 (DEFAULT_TABLE table=test-table [id=74cf6540b120497fb3fecaf371d64581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:00.777168 19427 tablet_service.cc:1467] Processing CreateTablet for tablet 50bad42d8a974c01a5a3670adfeab173 (DEFAULT_TABLE table=test-table [id=74cf6540b120497fb3fecaf371d64581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:00.777467 19843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50bad42d8a974c01a5a3670adfeab173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:00.777614 19427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50bad42d8a974c01a5a3670adfeab173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:00.784072 19635 tablet_service.cc:1467] Processing CreateTablet for tablet 50bad42d8a974c01a5a3670adfeab173 (DEFAULT_TABLE table=test-table [id=74cf6540b120497fb3fecaf371d64581]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:00.784746 19635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50bad42d8a974c01a5a3670adfeab173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:00.786569 19194 catalog_manager.cc:4841] TS b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65:38903): tablet 6110a10313da4bfc90f9eff7c1eb4019 (table test-table [id=f1509074fc364810ac85aa3e84a115f9]) successfully deleted
I20260806 10:41:00.791517 20079 tablet_bootstrap.cc:492] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405: Bootstrap starting.
I20260806 10:41:00.794245 20079 tablet_bootstrap.cc:654] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:00.803287 20079 tablet_bootstrap.cc:492] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405: No bootstrap required, opened a new log
I20260806 10:41:00.803568 20079 ts_tablet_manager.cc:1397] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260806 10:41:00.804515 20079 raft_consensus.cc:348] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.804879 20079 raft_consensus.cc:374] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:00.805030 20079 raft_consensus.cc:729] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712a94b41a0e4afc8924793d0f159405, State: Initialized, Role: FOLLOWER
I20260806 10:41:00.805411 20079 consensus_queue.cc:260] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.807021 20081 tablet_bootstrap.cc:492] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1: Bootstrap starting.
I20260806 10:41:00.808841 20079 ts_tablet_manager.cc:1428] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260806 10:41:00.809327 20081 tablet_bootstrap.cc:654] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:00.817770 20075 tablet_replica.cc:330] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405: stopping tablet replica
I20260806 10:41:00.818862 20083 tablet_bootstrap.cc:492] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2: Bootstrap starting.
I20260806 10:41:00.821085 20083 tablet_bootstrap.cc:654] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:00.822793 20076 tablet_replica.cc:330] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1: stopping tablet replica
I20260806 10:41:00.823079 20075 raft_consensus.cc:2229] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:00.823246 20076 raft_consensus.cc:2229] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:00.823580 20075 raft_consensus.cc:2258] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:00.823709 20076 raft_consensus.cc:2258] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:00.825728 20075 ts_tablet_manager.cc:1905] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:00.828039 20076 ts_tablet_manager.cc:1905] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:00.830137 20081 tablet_bootstrap.cc:492] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1: No bootstrap required, opened a new log
I20260806 10:41:00.830302 20081 ts_tablet_manager.cc:1397] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.015s
I20260806 10:41:00.835163 20081 raft_consensus.cc:348] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.835425 20081 raft_consensus.cc:374] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:00.835626 20081 raft_consensus.cc:729] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 460d72b92b8d4e879f6d1f6ab27893e1, State: Initialized, Role: FOLLOWER
I20260806 10:41:00.835852 20075 ts_tablet_manager.cc:1918] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:41:00.836028 20075 log.cc:1196] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/6110a10313da4bfc90f9eff7c1eb4019
I20260806 10:41:00.835912 20081 consensus_queue.cc:260] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.836599 20075 ts_tablet_manager.cc:1939] T 6110a10313da4bfc90f9eff7c1eb4019 P 712a94b41a0e4afc8924793d0f159405: Deleting consensus metadata
I20260806 10:41:00.838495 19195 catalog_manager.cc:4841] TS 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103): tablet 6110a10313da4bfc90f9eff7c1eb4019 (table test-table [id=f1509074fc364810ac85aa3e84a115f9]) successfully deleted
I20260806 10:41:00.839214 20081 ts_tablet_manager.cc:1428] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260806 10:41:00.839879 20083 tablet_bootstrap.cc:492] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2: No bootstrap required, opened a new log
I20260806 10:41:00.840051 20083 ts_tablet_manager.cc:1397] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.000s
I20260806 10:41:00.840672 20076 ts_tablet_manager.cc:1918] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:41:00.840850 20076 log.cc:1196] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/6110a10313da4bfc90f9eff7c1eb4019
I20260806 10:41:00.840938 20083 raft_consensus.cc:348] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.841220 20083 raft_consensus.cc:374] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:00.841323 20083 raft_consensus.cc:729] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0a8d6301cbf4c179566f746b8db38b2, State: Initialized, Role: FOLLOWER
I20260806 10:41:00.841401 20076 ts_tablet_manager.cc:1939] T 6110a10313da4bfc90f9eff7c1eb4019 P 460d72b92b8d4e879f6d1f6ab27893e1: Deleting consensus metadata
I20260806 10:41:00.841643 20083 consensus_queue.cc:260] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:00.843350 19191 catalog_manager.cc:4841] TS 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66:44389): tablet 6110a10313da4bfc90f9eff7c1eb4019 (table test-table [id=f1509074fc364810ac85aa3e84a115f9]) successfully deleted
I20260806 10:41:00.845078 20083 ts_tablet_manager.cc:1428] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260806 10:41:01.051522 19998 raft_consensus.cc:482] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:01.051848 19998 raft_consensus.cc:504] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:01.053049 19998 leader_election.cc:288] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66:44389), 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103)
I20260806 10:41:01.053463 19665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50bad42d8a974c01a5a3670adfeab173" candidate_uuid: "b0a8d6301cbf4c179566f746b8db38b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" is_pre_election: true
I20260806 10:41:01.053700 19665 raft_consensus.cc:2454] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0a8d6301cbf4c179566f746b8db38b2 in term 0.
I20260806 10:41:01.053593 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50bad42d8a974c01a5a3670adfeab173" candidate_uuid: "b0a8d6301cbf4c179566f746b8db38b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712a94b41a0e4afc8924793d0f159405" is_pre_election: true
I20260806 10:41:01.053967 19883 raft_consensus.cc:2454] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0a8d6301cbf4c179566f746b8db38b2 in term 0.
I20260806 10:41:01.054247 19351 leader_election.cc:302] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 460d72b92b8d4e879f6d1f6ab27893e1, b0a8d6301cbf4c179566f746b8db38b2; no voters:
I20260806 10:41:01.054590 19998 raft_consensus.cc:2781] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:01.054716 19998 raft_consensus.cc:482] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:01.054803 19998 raft_consensus.cc:3037] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:01.057039 19998 raft_consensus.cc:504] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:01.057682 19998 leader_election.cc:288] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [CANDIDATE]: Term 1 election: Requested vote from peers 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66:44389), 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103)
I20260806 10:41:01.058228 19665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50bad42d8a974c01a5a3670adfeab173" candidate_uuid: "b0a8d6301cbf4c179566f746b8db38b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "460d72b92b8d4e879f6d1f6ab27893e1"
I20260806 10:41:01.058386 19883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50bad42d8a974c01a5a3670adfeab173" candidate_uuid: "b0a8d6301cbf4c179566f746b8db38b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712a94b41a0e4afc8924793d0f159405"
I20260806 10:41:01.058481 19665 raft_consensus.cc:3037] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:01.058744 19883 raft_consensus.cc:3037] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:01.061324 19665 raft_consensus.cc:2454] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0a8d6301cbf4c179566f746b8db38b2 in term 1.
I20260806 10:41:01.061800 19351 leader_election.cc:302] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 460d72b92b8d4e879f6d1f6ab27893e1, b0a8d6301cbf4c179566f746b8db38b2; no voters:
I20260806 10:41:01.062270 19998 raft_consensus.cc:2781] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:01.062551 19998 raft_consensus.cc:686] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 1 LEADER]: Becoming Leader. State: Replica: b0a8d6301cbf4c179566f746b8db38b2, State: Running, Role: LEADER
I20260806 10:41:01.063005 19883 raft_consensus.cc:2454] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0a8d6301cbf4c179566f746b8db38b2 in term 1.
I20260806 10:41:01.062927 19998 consensus_queue.cc:237] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:01.066375 19215 catalog_manager.cc:5495] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65). New cstate: current_term: 1 leader_uuid: "b0a8d6301cbf4c179566f746b8db38b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260806 10:41:01.112828 19875 raft_consensus.cc:1261] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Refusing update from remote peer b0a8d6301cbf4c179566f746b8db38b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:01.113519 19998 consensus_queue.cc:1035] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:01.113674 19665 raft_consensus.cc:1261] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Refusing update from remote peer b0a8d6301cbf4c179566f746b8db38b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:01.114255 20051 consensus_queue.cc:1035] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:01.120473 20041 mvcc.cc:205] Tried to move back new op lower bound from 7315508679113338880 to 7315508678916538368. Current Snapshot: MvccSnapshot[applied={T|T < 7315508679113338880}]
I20260806 10:41:01.121609 20038 mvcc.cc:205] Tried to move back new op lower bound from 7315508679113338880 to 7315508678916538368. Current Snapshot: MvccSnapshot[applied={T|T < 7315508679113338880}]
W20260806 10:41:01.143546 20041 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 10:41:02.740577 19215 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:02.740798 19215 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:02.745754 19215 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965: Sending DeleteTablet for 3 replicas of tablet 50bad42d8a974c01a5a3670adfeab173
I20260806 10:41:02.746531 19427 tablet_service.cc:1514] Processing DeleteTablet for tablet 50bad42d8a974c01a5a3670adfeab173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:02 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:52110
I20260806 10:41:02.746755 19846 tablet_service.cc:1514] Processing DeleteTablet for tablet 50bad42d8a974c01a5a3670adfeab173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:02 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:47046
I20260806 10:41:02.746768 19636 tablet_service.cc:1514] Processing DeleteTablet for tablet 50bad42d8a974c01a5a3670adfeab173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:02 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:43238
I20260806 10:41:02.747246 20120 tablet_replica.cc:330] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2: stopping tablet replica
I20260806 10:41:02.747534 20120 raft_consensus.cc:2229] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:41:02.747983 20120 raft_consensus.cc:2258] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:02.749022 20122 tablet_replica.cc:330] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1: stopping tablet replica
I20260806 10:41:02.749372 20120 ts_tablet_manager.cc:1905] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:02.749687 20121 tablet_replica.cc:330] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405: stopping tablet replica
I20260806 10:41:02.749884 20121 raft_consensus.cc:2229] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:02.750125 20121 raft_consensus.cc:2258] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:02.750427 20122 raft_consensus.cc:2229] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:02.750679 20122 raft_consensus.cc:2258] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:02.751499 20121 ts_tablet_manager.cc:1905] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:02.757026 20120 ts_tablet_manager.cc:1918] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 10:41:02.757292 20120 log.cc:1196] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/50bad42d8a974c01a5a3670adfeab173
I20260806 10:41:02.757491 20122 ts_tablet_manager.cc:1905] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:02.757943 20120 ts_tablet_manager.cc:1939] T 50bad42d8a974c01a5a3670adfeab173 P b0a8d6301cbf4c179566f746b8db38b2: Deleting consensus metadata
I20260806 10:41:02.759297 19194 catalog_manager.cc:4841] TS b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65:38903): tablet 50bad42d8a974c01a5a3670adfeab173 (table test-table [id=74cf6540b120497fb3fecaf371d64581]) successfully deleted
I20260806 10:41:02.761698 20121 ts_tablet_manager.cc:1918] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 10:41:02.762027 20121 log.cc:1196] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/50bad42d8a974c01a5a3670adfeab173
I20260806 10:41:02.762795 20121 ts_tablet_manager.cc:1939] T 50bad42d8a974c01a5a3670adfeab173 P 712a94b41a0e4afc8924793d0f159405: Deleting consensus metadata
I20260806 10:41:02.763964 19195 catalog_manager.cc:4841] TS 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103): tablet 50bad42d8a974c01a5a3670adfeab173 (table test-table [id=74cf6540b120497fb3fecaf371d64581]) successfully deleted
I20260806 10:41:02.766073 20122 ts_tablet_manager.cc:1918] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 10:41:02.766288 20122 log.cc:1196] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/50bad42d8a974c01a5a3670adfeab173
I20260806 10:41:02.767030 20122 ts_tablet_manager.cc:1939] T 50bad42d8a974c01a5a3670adfeab173 P 460d72b92b8d4e879f6d1f6ab27893e1: Deleting consensus metadata
I20260806 10:41:02.768128 19191 catalog_manager.cc:4841] TS 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66:44389): tablet 50bad42d8a974c01a5a3670adfeab173 (table test-table [id=74cf6540b120497fb3fecaf371d64581]) successfully deleted
Aug 06 10:41:02 dist-test-slave-fgb3 krb5kdc[19144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012862, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 10:41:02 dist-test-slave-fgb3 krb5kdc[19144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012862, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:02.812851 20134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:02.791681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53274 (local address 127.16.45.126:42097)
0806 10:41:02.793039 (+ 1358us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:02.793045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:02.793101 (+ 56us) server_negotiation.cc:407] Connection header received
0806 10:41:02.793173 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:02.793177 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:02.793241 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:02.793334 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:02.795737 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:02.796920 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:02.798772 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:02.799315 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:02.799469 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:02.804986 (+ 5517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:02.804992 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:02.804996 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:02.805030 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:02.809337 (+ 4307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:02.810228 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:02.810232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:02.810235 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:02.810491 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:02.810987 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:02.810990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:02.810993 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:02.811415 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:02.811684 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:02.812054 (+ 370us) server_negotiation.cc:299] Negotiation successful
0806 10:41:02.812318 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1153,"thread_start_us":754,"threads_started":1}
I20260806 10:41:02.816975 19215 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53274:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:41:02.817747 19215 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:02.825055 19636 tablet_service.cc:1467] Processing CreateTablet for tablet 697b7035555f4538b7d2e2ce7198bf3e (DEFAULT_TABLE table=test-table [id=27788b222bf94490856ad99b227787f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:02.825081 19427 tablet_service.cc:1467] Processing CreateTablet for tablet 697b7035555f4538b7d2e2ce7198bf3e (DEFAULT_TABLE table=test-table [id=27788b222bf94490856ad99b227787f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:02.825528 19636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 697b7035555f4538b7d2e2ce7198bf3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:02.825621 19427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 697b7035555f4538b7d2e2ce7198bf3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:02.825625 19846 tablet_service.cc:1467] Processing CreateTablet for tablet 697b7035555f4538b7d2e2ce7198bf3e (DEFAULT_TABLE table=test-table [id=27788b222bf94490856ad99b227787f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:02.826051 19846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 697b7035555f4538b7d2e2ce7198bf3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:02.832913 20139 tablet_bootstrap.cc:492] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1: Bootstrap starting.
I20260806 10:41:02.833865 20141 tablet_bootstrap.cc:492] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405: Bootstrap starting.
I20260806 10:41:02.835868 20141 tablet_bootstrap.cc:654] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:02.835992 20139 tablet_bootstrap.cc:654] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:02.839861 20141 tablet_bootstrap.cc:492] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405: No bootstrap required, opened a new log
I20260806 10:41:02.839987 20139 tablet_bootstrap.cc:492] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1: No bootstrap required, opened a new log
I20260806 10:41:02.840103 20141 ts_tablet_manager.cc:1397] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 10:41:02.840174 20139 ts_tablet_manager.cc:1397] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260806 10:41:02.841111 20141 raft_consensus.cc:348] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:02.841374 20141 raft_consensus.cc:374] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:02.841234 20139 raft_consensus.cc:348] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:02.841584 20139 raft_consensus.cc:374] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:02.841580 20141 raft_consensus.cc:729] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712a94b41a0e4afc8924793d0f159405, State: Initialized, Role: FOLLOWER
I20260806 10:41:02.841712 20139 raft_consensus.cc:729] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 460d72b92b8d4e879f6d1f6ab27893e1, State: Initialized, Role: FOLLOWER
I20260806 10:41:02.841858 20141 consensus_queue.cc:260] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:02.842023 20139 consensus_queue.cc:260] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:02.842793 20139 ts_tablet_manager.cc:1428] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 10:41:02.842886 20142 tablet_bootstrap.cc:492] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2: Bootstrap starting.
I20260806 10:41:02.843539 20141 ts_tablet_manager.cc:1428] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 10:41:02.846060 20142 tablet_bootstrap.cc:654] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:02.850121 20142 tablet_bootstrap.cc:492] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2: No bootstrap required, opened a new log
I20260806 10:41:02.850378 20142 ts_tablet_manager.cc:1397] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260806 10:41:02.851473 20142 raft_consensus.cc:348] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:02.851776 20142 raft_consensus.cc:374] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:02.851946 20142 raft_consensus.cc:729] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0a8d6301cbf4c179566f746b8db38b2, State: Initialized, Role: FOLLOWER
I20260806 10:41:02.852176 20142 consensus_queue.cc:260] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:02.852794 20142 ts_tablet_manager.cc:1428] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260806 10:41:03.105023 20096 raft_consensus.cc:482] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:03.105343 20096 raft_consensus.cc:504] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:03.106371 20096 leader_election.cc:288] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65:38903), 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103)
I20260806 10:41:03.107223 19875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "697b7035555f4538b7d2e2ce7198bf3e" candidate_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712a94b41a0e4afc8924793d0f159405" is_pre_election: true
I20260806 10:41:03.107319 19454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "697b7035555f4538b7d2e2ce7198bf3e" candidate_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0a8d6301cbf4c179566f746b8db38b2" is_pre_election: true
I20260806 10:41:03.107651 19454 raft_consensus.cc:2454] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 460d72b92b8d4e879f6d1f6ab27893e1 in term 0.
I20260806 10:41:03.107663 19875 raft_consensus.cc:2454] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 460d72b92b8d4e879f6d1f6ab27893e1 in term 0.
I20260806 10:41:03.108304 19565 leader_election.cc:302] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 460d72b92b8d4e879f6d1f6ab27893e1, 712a94b41a0e4afc8924793d0f159405, b0a8d6301cbf4c179566f746b8db38b2; no voters:
I20260806 10:41:03.108685 20096 raft_consensus.cc:2781] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:03.108903 20096 raft_consensus.cc:482] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:03.109076 20096 raft_consensus.cc:3037] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:03.112315 20096 raft_consensus.cc:504] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:03.112957 20096 leader_election.cc:288] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [CANDIDATE]: Term 1 election: Requested vote from peers b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65:38903), 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103)
I20260806 10:41:03.113722 19875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "697b7035555f4538b7d2e2ce7198bf3e" candidate_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "712a94b41a0e4afc8924793d0f159405"
I20260806 10:41:03.113796 19454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "697b7035555f4538b7d2e2ce7198bf3e" candidate_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0a8d6301cbf4c179566f746b8db38b2"
I20260806 10:41:03.114126 19875 raft_consensus.cc:3037] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:03.114163 19454 raft_consensus.cc:3037] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:03.118028 19875 raft_consensus.cc:2454] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 460d72b92b8d4e879f6d1f6ab27893e1 in term 1.
I20260806 10:41:03.118525 19454 raft_consensus.cc:2454] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 460d72b92b8d4e879f6d1f6ab27893e1 in term 1.
I20260806 10:41:03.118680 19565 leader_election.cc:302] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 460d72b92b8d4e879f6d1f6ab27893e1, 712a94b41a0e4afc8924793d0f159405; no voters:
I20260806 10:41:03.119196 20096 raft_consensus.cc:2781] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:03.119433 20096 raft_consensus.cc:686] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 LEADER]: Becoming Leader. State: Replica: 460d72b92b8d4e879f6d1f6ab27893e1, State: Running, Role: LEADER
I20260806 10:41:03.119853 20096 consensus_queue.cc:237] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:03.123503 19219 catalog_manager.cc:5495] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66). New cstate: current_term: 1 leader_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } health_report { overall_health: UNKNOWN } } }
I20260806 10:41:03.216655 20152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:03.209207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43264 (local address 127.16.45.66:44389)
0806 10:41:03.210241 (+ 1034us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:03.210245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:03.210300 (+ 55us) server_negotiation.cc:407] Connection header received
0806 10:41:03.210408 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:03.210412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:03.210520 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:03.210605 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:03.211166 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.212477 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.214092 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.214920 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.215024 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:03.215625 (+ 601us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:03.215737 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:03.215808 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:03.215975 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 10:41:03.216046 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":878,"thread_start_us":681,"threads_started":1}
I20260806 10:41:03.233414 20152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:03.227122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:48149 (local address 127.16.45.66:44389)
0806 10:41:03.227278 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:03.227282 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:03.227957 (+ 675us) server_negotiation.cc:407] Connection header received
0806 10:41:03.228084 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:03.228087 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:03.228151 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:03.228226 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:03.228698 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.229652 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.231558 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.232127 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.232229 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:03.232767 (+ 538us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:03.232873 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:03.232941 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:03.233031 (+ 90us) server_negotiation.cc:299] Negotiation successful
0806 10:41:03.233093 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 10:41:03.233763 20157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:03.227077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:44389 (local address 127.16.45.66:48149)
0806 10:41:03.227852 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:03.227868 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:03.227987 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:03.228244 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:03.228247 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:03.228256 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 10:41:03.228574 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:03.228583 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.229787 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.229790 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:03.231408 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:03.231421 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.232347 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.232353 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:03.232589 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:03.232629 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 10:41:03.232946 (+ 317us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 10:41:03.232954 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 10:41:03.233010 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 10:41:03.233190 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":403,"threads_started":1}
I20260806 10:41:03.242168 19875 raft_consensus.cc:1261] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Refusing update from remote peer 460d72b92b8d4e879f6d1f6ab27893e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:03.242483 19454 raft_consensus.cc:1261] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Refusing update from remote peer 460d72b92b8d4e879f6d1f6ab27893e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:03.242929 20113 consensus_queue.cc:1035] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:03.243337 20026 consensus_queue.cc:1035] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:03.301561 19217 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:03.301911 19217 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:03.305576 19217 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965: Sending DeleteTablet for 3 replicas of tablet 697b7035555f4538b7d2e2ce7198bf3e
I20260806 10:41:03.306543 19427 tablet_service.cc:1514] Processing DeleteTablet for tablet 697b7035555f4538b7d2e2ce7198bf3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:03 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:52110
I20260806 10:41:03.306720 19635 tablet_service.cc:1514] Processing DeleteTablet for tablet 697b7035555f4538b7d2e2ce7198bf3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:03 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:43238
I20260806 10:41:03.307232 19846 tablet_service.cc:1514] Processing DeleteTablet for tablet 697b7035555f4538b7d2e2ce7198bf3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:03 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:47046
I20260806 10:41:03.307700 20163 tablet_replica.cc:330] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2: stopping tablet replica
I20260806 10:41:03.308023 20163 raft_consensus.cc:2229] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:03.308447 20163 raft_consensus.cc:2258] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:03.309027 19217 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53274:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:41:03.309898 19217 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:03.310024 20163 ts_tablet_manager.cc:1905] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:03.319075 20167 tablet_replica.cc:330] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405: stopping tablet replica
I20260806 10:41:03.319314 20163 ts_tablet_manager.cc:1918] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:41:03.319631 20163 log.cc:1196] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/697b7035555f4538b7d2e2ce7198bf3e
I20260806 10:41:03.319919 20167 raft_consensus.cc:2229] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:03.320331 20167 raft_consensus.cc:2258] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:03.320511 20163 ts_tablet_manager.cc:1939] T 697b7035555f4538b7d2e2ce7198bf3e P b0a8d6301cbf4c179566f746b8db38b2: Deleting consensus metadata
I20260806 10:41:03.321990 19194 catalog_manager.cc:4841] TS b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65:38903): tablet 697b7035555f4538b7d2e2ce7198bf3e (table test-table [id=27788b222bf94490856ad99b227787f5]) successfully deleted
I20260806 10:41:03.324271 20167 ts_tablet_manager.cc:1905] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:03.328325 19636 tablet_service.cc:1467] Processing CreateTablet for tablet 11ca8beb04dd417cb0f411795420c38a (DEFAULT_TABLE table=test-table [id=071f1ab969ee45a3b9b23db2c20f1c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:03.328819 19636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11ca8beb04dd417cb0f411795420c38a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:03.329097 19427 tablet_service.cc:1467] Processing CreateTablet for tablet 11ca8beb04dd417cb0f411795420c38a (DEFAULT_TABLE table=test-table [id=071f1ab969ee45a3b9b23db2c20f1c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:03.329813 19427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11ca8beb04dd417cb0f411795420c38a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:03.333501 20167 ts_tablet_manager.cc:1918] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:41:03.333761 20167 log.cc:1196] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/697b7035555f4538b7d2e2ce7198bf3e
I20260806 10:41:03.334497 20167 ts_tablet_manager.cc:1939] T 697b7035555f4538b7d2e2ce7198bf3e P 712a94b41a0e4afc8924793d0f159405: Deleting consensus metadata
I20260806 10:41:03.335026 19846 tablet_service.cc:1467] Processing CreateTablet for tablet 11ca8beb04dd417cb0f411795420c38a (DEFAULT_TABLE table=test-table [id=071f1ab969ee45a3b9b23db2c20f1c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:03.335628 19846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11ca8beb04dd417cb0f411795420c38a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:03.335662 19195 catalog_manager.cc:4841] TS 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103): tablet 697b7035555f4538b7d2e2ce7198bf3e (table test-table [id=27788b222bf94490856ad99b227787f5]) successfully deleted
I20260806 10:41:03.340482 20142 tablet_bootstrap.cc:492] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2: Bootstrap starting.
I20260806 10:41:03.342625 20141 tablet_bootstrap.cc:492] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405: Bootstrap starting.
I20260806 10:41:03.343986 20142 tablet_bootstrap.cc:654] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:03.345515 20141 tablet_bootstrap.cc:654] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:03.348889 20173 tablet_bootstrap.cc:492] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1: Bootstrap starting.
I20260806 10:41:03.349776 20142 tablet_bootstrap.cc:492] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2: No bootstrap required, opened a new log
I20260806 10:41:03.350033 20142 ts_tablet_manager.cc:1397] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20260806 10:41:03.351027 20164 tablet_replica.cc:330] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1: stopping tablet replica
I20260806 10:41:03.351349 20164 raft_consensus.cc:2229] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:41:03.351377 20142 raft_consensus.cc:348] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:03.351752 20142 raft_consensus.cc:374] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:03.351954 20142 raft_consensus.cc:729] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0a8d6301cbf4c179566f746b8db38b2, State: Initialized, Role: FOLLOWER
I20260806 10:41:03.352358 20164 raft_consensus.cc:2258] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:03.353721 20164 ts_tablet_manager.cc:1905] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:03.353739 20142 consensus_queue.cc:260] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:03.359124 20142 ts_tablet_manager.cc:1428] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2: Time spent starting tablet: real 0.009s user 0.000s sys 0.003s
I20260806 10:41:03.360873 20141 tablet_bootstrap.cc:492] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405: No bootstrap required, opened a new log
I20260806 10:41:03.361140 20141 ts_tablet_manager.cc:1397] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.014s
I20260806 10:41:03.362330 20141 raft_consensus.cc:348] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:03.362847 20141 raft_consensus.cc:374] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:03.363058 20141 raft_consensus.cc:729] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 712a94b41a0e4afc8924793d0f159405, State: Initialized, Role: FOLLOWER
I20260806 10:41:03.363518 20141 consensus_queue.cc:260] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:03.363620 20164 ts_tablet_manager.cc:1918] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:41:03.363832 20164 log.cc:1196] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/697b7035555f4538b7d2e2ce7198bf3e
I20260806 10:41:03.364246 20141 ts_tablet_manager.cc:1428] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 10:41:03.364940 20164 ts_tablet_manager.cc:1939] T 697b7035555f4538b7d2e2ce7198bf3e P 460d72b92b8d4e879f6d1f6ab27893e1: Deleting consensus metadata
I20260806 10:41:03.366256 19191 catalog_manager.cc:4841] TS 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66:44389): tablet 697b7035555f4538b7d2e2ce7198bf3e (table test-table [id=27788b222bf94490856ad99b227787f5]) successfully deleted
I20260806 10:41:03.367659 20173 tablet_bootstrap.cc:654] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:03.372043 20173 tablet_bootstrap.cc:492] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1: No bootstrap required, opened a new log
I20260806 10:41:03.372279 20173 ts_tablet_manager.cc:1397] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.000s
I20260806 10:41:03.372857 20146 raft_consensus.cc:482] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:03.373240 20146 raft_consensus.cc:504] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:03.373581 20173 raft_consensus.cc:348] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:03.373993 20173 raft_consensus.cc:374] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:03.374248 20173 raft_consensus.cc:729] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 460d72b92b8d4e879f6d1f6ab27893e1, State: Initialized, Role: FOLLOWER
I20260806 10:41:03.374588 20173 consensus_queue.cc:260] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:03.375353 20173 ts_tablet_manager.cc:1428] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 10:41:03.375746 20146 leader_election.cc:288] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65:38903), 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66:44389)
I20260806 10:41:03.389745 20152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:03.376095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:41689 (local address 127.16.45.66:44389)
0806 10:41:03.376651 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:03.376657 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:03.380287 (+ 3630us) server_negotiation.cc:407] Connection header received
0806 10:41:03.380549 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:03.380554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:03.380630 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:03.380724 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:03.381934 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.383169 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.386548 (+ 3379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.388404 (+ 1856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.388627 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:03.388719 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:03.389209 (+ 490us) server_negotiation.cc:299] Negotiation successful
0806 10:41:03.389405 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423}
I20260806 10:41:03.390946 20179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:03.375795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:44389 (local address 127.16.45.67:41689)
0806 10:41:03.380157 (+ 4362us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:03.380177 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:03.380388 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:03.380901 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:03.380906 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:03.380983 (+ 77us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:03.381667 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:03.381683 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.383347 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.383350 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:03.386381 (+ 3031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:03.386397 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.388786 (+ 2389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.388795 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:03.389027 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:03.389053 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 10:41:03.390058 (+ 1005us) client_negotiation.cc:240] Negotiation successful
0806 10:41:03.390166 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4149,"mutex_wait_us":16,"spinlock_wait_cycles":1280,"thread_start_us":3397,"threads_started":1}
I20260806 10:41:03.391796 19665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ca8beb04dd417cb0f411795420c38a" candidate_uuid: "712a94b41a0e4afc8924793d0f159405" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" is_pre_election: true
I20260806 10:41:03.392254 19665 raft_consensus.cc:2454] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712a94b41a0e4afc8924793d0f159405 in term 0.
I20260806 10:41:03.392999 19765 leader_election.cc:302] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 460d72b92b8d4e879f6d1f6ab27893e1, 712a94b41a0e4afc8924793d0f159405; no voters:
I20260806 10:41:03.393455 20180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:03.376137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:53699 (local address 127.16.45.65:38903)
0806 10:41:03.377219 (+ 1082us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:03.377226 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:03.379882 (+ 2656us) server_negotiation.cc:407] Connection header received
0806 10:41:03.380132 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:03.380136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:03.380196 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:03.380276 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:03.382614 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.384347 (+ 1733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.388004 (+ 3657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.391792 (+ 3788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.392068 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:03.392149 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:03.392605 (+ 456us) server_negotiation.cc:299] Negotiation successful
0806 10:41:03.392788 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":863,"thread_start_us":596,"threads_started":1}
I20260806 10:41:03.393520 20181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:03.375765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38903 (local address 127.16.45.67:53699)
0806 10:41:03.379769 (+ 4004us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:03.379793 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:03.379968 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:03.380908 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:03.380912 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:03.380993 (+ 81us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:03.382351 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:03.382369 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.384498 (+ 2129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.384503 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:03.387777 (+ 3274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:03.387794 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.392079 (+ 4285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.392088 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:03.392425 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:03.392460 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 10:41:03.392670 (+ 210us) client_negotiation.cc:240] Negotiation successful
0806 10:41:03.392806 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3734,"mutex_wait_us":24,"spinlock_wait_cycles":15104,"thread_start_us":3828,"threads_started":1}
I20260806 10:41:03.393999 20146 raft_consensus.cc:2781] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:03.394189 20146 raft_consensus.cc:482] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:03.394423 20146 raft_consensus.cc:3037] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:03.394448 19454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ca8beb04dd417cb0f411795420c38a" candidate_uuid: "712a94b41a0e4afc8924793d0f159405" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0a8d6301cbf4c179566f746b8db38b2" is_pre_election: true
I20260806 10:41:03.394824 19454 raft_consensus.cc:2454] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 712a94b41a0e4afc8924793d0f159405 in term 0.
I20260806 10:41:03.398200 20146 raft_consensus.cc:504] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:03.399286 20146 leader_election.cc:288] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [CANDIDATE]: Term 1 election: Requested vote from peers b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65:38903), 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66:44389)
I20260806 10:41:03.399871 19454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ca8beb04dd417cb0f411795420c38a" candidate_uuid: "712a94b41a0e4afc8924793d0f159405" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0a8d6301cbf4c179566f746b8db38b2"
I20260806 10:41:03.399845 19665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ca8beb04dd417cb0f411795420c38a" candidate_uuid: "712a94b41a0e4afc8924793d0f159405" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "460d72b92b8d4e879f6d1f6ab27893e1"
I20260806 10:41:03.400180 19454 raft_consensus.cc:3037] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:03.400183 19665 raft_consensus.cc:3037] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:03.404644 19665 raft_consensus.cc:2454] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712a94b41a0e4afc8924793d0f159405 in term 1.
I20260806 10:41:03.404682 19454 raft_consensus.cc:2454] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 712a94b41a0e4afc8924793d0f159405 in term 1.
I20260806 10:41:03.405175 19765 leader_election.cc:302] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 460d72b92b8d4e879f6d1f6ab27893e1, 712a94b41a0e4afc8924793d0f159405; no voters:
I20260806 10:41:03.405578 20146 raft_consensus.cc:2781] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:03.406679 20146 raft_consensus.cc:686] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 1 LEADER]: Becoming Leader. State: Replica: 712a94b41a0e4afc8924793d0f159405, State: Running, Role: LEADER
I20260806 10:41:03.407248 20146 consensus_queue.cc:237] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } }
I20260806 10:41:03.412320 19217 catalog_manager.cc:5495] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 reported cstate change: term changed from 0 to 1, leader changed from <none> to 712a94b41a0e4afc8924793d0f159405 (127.16.45.67). New cstate: current_term: 1 leader_uuid: "712a94b41a0e4afc8924793d0f159405" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "712a94b41a0e4afc8924793d0f159405" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37103 } health_report { overall_health: HEALTHY } } }
I20260806 10:41:03.442284 20189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:03.432772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47062 (local address 127.16.45.67:37103)
0806 10:41:03.434144 (+ 1372us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:03.434149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:03.434190 (+ 41us) server_negotiation.cc:407] Connection header received
0806 10:41:03.434339 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:03.434346 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:03.434484 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:03.434666 (+ 182us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:03.435408 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.436883 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.438950 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.439761 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.439878 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:03.440615 (+ 737us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:03.441337 (+ 722us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:03.441470 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:03.441581 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 10:41:03.441664 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1163,"thread_start_us":855,"threads_started":1}
I20260806 10:41:03.465546 20152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:03.457057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:50213 (local address 127.16.45.66:44389)
0806 10:41:03.457260 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:03.457267 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:03.457750 (+ 483us) server_negotiation.cc:407] Connection header received
0806 10:41:03.457953 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:03.457957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:03.458036 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:03.458137 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:03.459301 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.460584 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.462934 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.463764 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.463887 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:03.464556 (+ 669us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:03.464774 (+ 218us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:03.464859 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:03.465043 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 10:41:03.465121 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 10:41:03.465821 20194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:03.456589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:44389 (local address 127.16.45.67:50213)
0806 10:41:03.457641 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:03.457657 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:03.457823 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:03.458156 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:03.458160 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:03.458173 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 10:41:03.459082 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:03.459094 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.460800 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.460804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:03.462798 (+ 1994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:03.462812 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.464014 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.464021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:03.464288 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:03.464350 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 10:41:03.464882 (+ 532us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 10:41:03.464931 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 10:41:03.465003 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 10:41:03.465149 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":912,"thread_start_us":556,"threads_started":1}
I20260806 10:41:03.477399 19665 raft_consensus.cc:1261] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Refusing update from remote peer 712a94b41a0e4afc8924793d0f159405: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:03.477744 19454 raft_consensus.cc:1261] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Refusing update from remote peer 712a94b41a0e4afc8924793d0f159405: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:03.478358 20184 consensus_queue.cc:1035] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [LEADER]: Connected to new peer: Peer: permanent_uuid: "460d72b92b8d4e879f6d1f6ab27893e1" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260806 10:41:03.479270 20146 consensus_queue.cc:1035] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0a8d6301cbf4c179566f746b8db38b2" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:03.487534 20097 mvcc.cc:205] Tried to move back new op lower bound from 7315508688796581888 to 7315508688520855552. Current Snapshot: MvccSnapshot[applied={T|T < 7315508688796581888}]
I20260806 10:41:03.516323 20189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:03.507846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:54133 (local address 127.16.45.67:37103)
0806 10:41:03.508026 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:03.508033 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:03.508788 (+ 755us) server_negotiation.cc:407] Connection header received
0806 10:41:03.508875 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:03.508880 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:03.508964 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:03.509045 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:03.510008 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.511248 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.513612 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.514653 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.514857 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:03.515446 (+ 589us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:03.515572 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:03.515650 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:03.515791 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 10:41:03.515922 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:41:03.516458 20157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:03.508015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:37103 (local address 127.16.45.66:54133)
0806 10:41:03.508517 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:03.508542 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:03.508675 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:03.509350 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:03.509355 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:03.509369 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 10:41:03.509778 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:03.509801 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.511415 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.511422 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:03.513420 (+ 1998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:03.513436 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:03.514916 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:03.514922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:03.515198 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:03.515242 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 10:41:03.515666 (+ 424us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 10:41:03.515679 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 10:41:03.515759 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 10:41:03.515937 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269}
W20260806 10:41:03.518265 20097 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 10:41:05.159232 19217 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:05.159578 19217 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:05.164832 19217 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83cd0492b54344278f5c124a4e3a9965: Sending DeleteTablet for 3 replicas of tablet 11ca8beb04dd417cb0f411795420c38a
I20260806 10:41:05.165797 19427 tablet_service.cc:1514] Processing DeleteTablet for tablet 11ca8beb04dd417cb0f411795420c38a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:05 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:52110
I20260806 10:41:05.165802 19846 tablet_service.cc:1514] Processing DeleteTablet for tablet 11ca8beb04dd417cb0f411795420c38a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:05 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:47046
I20260806 10:41:05.165894 19636 tablet_service.cc:1514] Processing DeleteTablet for tablet 11ca8beb04dd417cb0f411795420c38a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:05 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:43238
I20260806 10:41:05.167860 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 19321
I20260806 10:41:05.168716 20240 tablet_replica.cc:330] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2: stopping tablet replica
I20260806 10:41:05.168908 20240 raft_consensus.cc:2229] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:05.169145 20240 raft_consensus.cc:2258] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:05.181890 20240 ts_tablet_manager.cc:1905] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:05.182152 20239 tablet_replica.cc:330] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405: stopping tablet replica
I20260806 10:41:05.182436 20239 raft_consensus.cc:2229] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:41:05.183243 20239 raft_consensus.cc:2258] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:05.184379 20239 ts_tablet_manager.cc:1905] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:05.185395 20241 tablet_replica.cc:330] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1: stopping tablet replica
I20260806 10:41:05.185755 20241 raft_consensus.cc:2229] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:05.186260 20241 raft_consensus.cc:2258] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:05.187337 20241 ts_tablet_manager.cc:1905] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:05.191025 20239 ts_tablet_manager.cc:1918] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 10:41:05.191293 20239 log.cc:1196] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/11ca8beb04dd417cb0f411795420c38a
I20260806 10:41:05.192085 20239 ts_tablet_manager.cc:1939] T 11ca8beb04dd417cb0f411795420c38a P 712a94b41a0e4afc8924793d0f159405: Deleting consensus metadata
I20260806 10:41:05.192637 20240 ts_tablet_manager.cc:1918] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 10:41:05.193342 19195 catalog_manager.cc:4841] TS 712a94b41a0e4afc8924793d0f159405 (127.16.45.67:37103): tablet 11ca8beb04dd417cb0f411795420c38a (table test-table [id=071f1ab969ee45a3b9b23db2c20f1c28]) successfully deleted
I20260806 10:41:05.194692 20240 log.cc:1196] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/11ca8beb04dd417cb0f411795420c38a
I20260806 10:41:05.195540 20240 ts_tablet_manager.cc:1939] T 11ca8beb04dd417cb0f411795420c38a P b0a8d6301cbf4c179566f746b8db38b2: Deleting consensus metadata
I20260806 10:41:05.196720 19194 catalog_manager.cc:4841] TS b0a8d6301cbf4c179566f746b8db38b2 (127.16.45.65:38903): tablet 11ca8beb04dd417cb0f411795420c38a (table test-table [id=071f1ab969ee45a3b9b23db2c20f1c28]) successfully deleted
I20260806 10:41:05.197283 20241 ts_tablet_manager.cc:1918] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 10:41:05.197458 20241 log.cc:1196] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/11ca8beb04dd417cb0f411795420c38a
I20260806 10:41:05.198354 20241 ts_tablet_manager.cc:1939] T 11ca8beb04dd417cb0f411795420c38a P 460d72b92b8d4e879f6d1f6ab27893e1: Deleting consensus metadata
I20260806 10:41:05.199324 19191 catalog_manager.cc:4841] TS 460d72b92b8d4e879f6d1f6ab27893e1 (127.16.45.66:44389): tablet 11ca8beb04dd417cb0f411795420c38a (table test-table [id=071f1ab969ee45a3b9b23db2c20f1c28]) successfully deleted
Aug 06 10:41:05 dist-test-slave-fgb3 krb5kdc[19144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012862, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:41:05.219581 20244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:05.170028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37758 (local address 127.16.45.65:38903)
0806 10:41:05.189855 (+ 19827us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:05.189863 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:05.189889 (+ 26us) server_negotiation.cc:407] Connection header received
0806 10:41:05.189955 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:05.189961 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:05.190047 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:05.194451 (+ 4404us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:05.196334 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:05.197805 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:05.200092 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:05.200680 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:05.200783 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:05.210762 (+ 9979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:05.210782 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:05.210800 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:05.210849 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:05.215406 (+ 4557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:05.216413 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:05.216422 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:05.216424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:05.216737 (+ 313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:05.217198 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:05.217202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:05.217204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:05.217820 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:05.218161 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:05.218648 (+ 487us) server_negotiation.cc:299] Negotiation successful
0806 10:41:05.218949 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19564,"thread_start_us":20178,"threads_started":1}
W20260806 10:41:05.220868 19528 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37758
W20260806 10:41:05.221678 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 19321: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:41:05.222100 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 19321
I20260806 10:41:05.249778 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 19541
Aug 06 10:41:05 dist-test-slave-fgb3 krb5kdc[19144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012862, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:41:05.266614 20245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:05.250687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39944 (local address 127.16.45.66:44389)
0806 10:41:05.251820 (+ 1133us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:05.251824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:05.251841 (+ 17us) server_negotiation.cc:407] Connection header received
0806 10:41:05.251895 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:05.251899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:05.251997 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:05.252086 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:05.253312 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:05.254253 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:05.255835 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:05.256600 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:05.256702 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:05.260890 (+ 4188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:05.260908 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:05.260924 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:05.260963 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:05.263798 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:05.264532 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:05.264539 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:05.264541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:05.264676 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:05.265088 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:05.265092 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:05.265094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:05.265506 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:05.265738 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:05.266091 (+ 353us) server_negotiation.cc:299] Negotiation successful
0806 10:41:05.266268 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1009,"thread_start_us":750,"threads_started":1}
W20260806 10:41:05.267393 19731 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39944
W20260806 10:41:05.268117 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 19541: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:41:05.268261 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 19541
I20260806 10:41:05.298955 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 19742
Aug 06 10:41:05 dist-test-slave-fgb3 krb5kdc[19144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012862, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:41:05.316013 20246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:05.299721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50578 (local address 127.16.45.67:37103)
0806 10:41:05.300296 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:05.300301 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:05.300317 (+ 16us) server_negotiation.cc:407] Connection header received
0806 10:41:05.300374 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:05.300378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:05.300441 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:05.300531 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:05.301882 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:05.302846 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:05.304090 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:05.304512 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:05.304604 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:05.308665 (+ 4061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:05.308681 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:05.308698 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:05.308738 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:05.311682 (+ 2944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:05.312974 (+ 1292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:05.312985 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:05.312989 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:05.313178 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:05.313762 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:05.313767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:05.313771 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:05.314413 (+ 642us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:05.314730 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:05.315481 (+ 751us) server_negotiation.cc:299] Negotiation successful
0806 10:41:05.315722 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":300,"threads_started":1}
W20260806 10:41:05.318799 19946 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50578
W20260806 10:41:05.319644 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 19742: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:41:05.319839 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 19742
I20260806 10:41:05.352449 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 19165
I20260806 10:41:05.353798 19278 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:05.471478 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 19165
2026-08-06T10:41:05Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9200 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:41:05 dist-test-slave-fgb3 krb5kdc[20252](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:41:05 dist-test-slave-fgb3 krb5kdc[20252](info): set up 2 sockets
Aug 06 10:41:05 dist-test-slave-fgb3 krb5kdc[20252](info): commencing operation
krb5kdc: starting...
W20260806 10:41:06.644120 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:41:06 dist-test-slave-fgb3 krb5kdc[20252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:41:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:41:06.844347 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:44353
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:34269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:44353
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:07.167433 20271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:07.167745 20271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:07.167886 20271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:07.175069 20271 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:07.175191 20271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:07.175273 20271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:07.175357 20271 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:07.175415 20271 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:07.185240 20271 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:44353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:44353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:07.186650 20271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:07.187987 20271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:07.199771 20285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:07.199800 20283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:07.199883 20287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:07.200507 20271 server_base.cc:1034] running on GCE node
I20260806 10:41:07.201269 20271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:07.202713 20271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:07.203922 20271 hybrid_clock.cc:648] HybridClock initialized: now 1786012867203871 us; error 36 us; skew 500 ppm
I20260806 10:41:07.204262 20271 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:07 dist-test-slave-fgb3 krb5kdc[20252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012867, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:07.207324 20271 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:41:07.208890 20271 webserver.cc:460] Webserver started at http://127.16.45.126:35087/ using document root <none> and password file <none>
I20260806 10:41:07.209579 20271 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:07.209700 20271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:07.210007 20271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:07.213114 20271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "8fa80a0430ff4ffe8faff1d4df98f4f0"
format_stamp: "Formatted at 2026-08-06 10:41:07 on dist-test-slave-fgb3"
server_key: "d6a0726f951c8c42b2dbb9d845287f1a"
server_key_iv: "ffaaaa1423060a8c2dccc4a08b7ab80b"
server_key_version: "encryptionkey@0"
I20260806 10:41:07.213861 20271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "8fa80a0430ff4ffe8faff1d4df98f4f0"
format_stamp: "Formatted at 2026-08-06 10:41:07 on dist-test-slave-fgb3"
server_key: "d6a0726f951c8c42b2dbb9d845287f1a"
server_key_iv: "ffaaaa1423060a8c2dccc4a08b7ab80b"
server_key_version: "encryptionkey@0"
I20260806 10:41:07.219089 20271 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 10:41:07.222499 20301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:07.223798 20271 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 10:41:07.223969 20271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "8fa80a0430ff4ffe8faff1d4df98f4f0"
format_stamp: "Formatted at 2026-08-06 10:41:07 on dist-test-slave-fgb3"
server_key: "d6a0726f951c8c42b2dbb9d845287f1a"
server_key_iv: "ffaaaa1423060a8c2dccc4a08b7ab80b"
server_key_version: "encryptionkey@0"
I20260806 10:41:07.224153 20271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:07.247737 20271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:07.252112 20271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:07.252374 20271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:07.269737 20271 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:44353
I20260806 10:41:07.269757 20388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:44353 every 8 connection(s)
I20260806 10:41:07.271093 20271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:07.274029 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 20271
I20260806 10:41:07.274271 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:07.275092 16565 external_mini_cluster.cc:1428] Setting key fc8a5845bf36a66898f193f26f025530
I20260806 10:41:07.275290 20390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:07.287711 20390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0: Bootstrap starting.
I20260806 10:41:07.291400 20390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:07.292451 20390 log.cc:824] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:07.295320 20390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0: No bootstrap required, opened a new log
Aug 06 10:41:07 dist-test-slave-fgb3 krb5kdc[20252](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:07.304702 20393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:07.277325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54520 (local address 127.16.45.126:44353)
0806 10:41:07.278276 (+ 951us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:07.278294 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:07.283007 (+ 4713us) server_negotiation.cc:407] Connection header received
0806 10:41:07.285943 (+ 2936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:07.285975 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:07.286541 (+ 566us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:07.286985 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:07.288376 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:07.290400 (+ 2024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:07.291667 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:07.292377 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:07.292557 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:07.296529 (+ 3972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:07.296541 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:07.296560 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:07.296604 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:07.300545 (+ 3941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:07.301394 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:07.301401 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:07.301407 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:07.301597 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:07.301992 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:07.301996 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:07.301998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:07.302606 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:07.302813 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:07.303270 (+ 457us) server_negotiation.cc:299] Negotiation successful
0806 10:41:07.303652 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":387,"threads_started":1}
I20260806 10:41:07.305112 20390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa80a0430ff4ffe8faff1d4df98f4f0" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44353 } }
I20260806 10:41:07.305464 20390 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:07.305575 20390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa80a0430ff4ffe8faff1d4df98f4f0, State: Initialized, Role: FOLLOWER
I20260806 10:41:07.306139 20390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa80a0430ff4ffe8faff1d4df98f4f0" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44353 } }
I20260806 10:41:07.306437 20390 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:07.306573 20390 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:07.306749 20390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:07.309111 20390 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa80a0430ff4ffe8faff1d4df98f4f0" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44353 } }
I20260806 10:41:07.309574 20390 leader_election.cc:302] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fa80a0430ff4ffe8faff1d4df98f4f0; no voters:
I20260806 10:41:07.310173 20390 leader_election.cc:288] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:07.310271 20399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:07.311460 20399 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa80a0430ff4ffe8faff1d4df98f4f0, State: Running, Role: LEADER
I20260806 10:41:07.312119 20399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa80a0430ff4ffe8faff1d4df98f4f0" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44353 } }
I20260806 10:41:07.312660 20390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:07.315605 20404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fa80a0430ff4ffe8faff1d4df98f4f0. Latest consensus state: current_term: 1 leader_uuid: "8fa80a0430ff4ffe8faff1d4df98f4f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa80a0430ff4ffe8faff1d4df98f4f0" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44353 } } }
I20260806 10:41:07.316085 20404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:07.316504 20402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fa80a0430ff4ffe8faff1d4df98f4f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fa80a0430ff4ffe8faff1d4df98f4f0" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44353 } } }
I20260806 10:41:07.318157 20409 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:07.318223 20402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:07.324420 20409 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:07.339425 20409 catalog_manager.cc:1347] Generated new cluster ID: bed892b9b86c4ea1953cf3a6635a023c
I20260806 10:41:07.339555 20409 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:07.348205 20409 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:07.349997 20409 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:07.358348 20409 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8fa80a0430ff4ffe8faff1d4df98f4f0: Generated new TSK 0
I20260806 10:41:07.359323 20409 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:41:07.411602 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44353
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:34269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:07.733364 20429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:07.733637 20429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:07.733757 20429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:07.741048 20429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:07.741158 20429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:07.741310 20429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:41:07.750968 20429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:07.752199 20429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:07.753545 20429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:07.766547 20436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:07.766510 20437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:07.766578 20440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:07.767707 20429 server_base.cc:1034] running on GCE node
I20260806 10:41:07.768306 20429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:07.769214 20429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:07.770406 20429 hybrid_clock.cc:648] HybridClock initialized: now 1786012867770357 us; error 32 us; skew 500 ppm
I20260806 10:41:07.770701 20429 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:07 dist-test-slave-fgb3 krb5kdc[20252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012867, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:07.773669 20429 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:41:07.775259 20429 webserver.cc:460] Webserver started at http://127.16.45.65:33575/ using document root <none> and password file <none>
I20260806 10:41:07.775969 20429 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:07.776084 20429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:07.776372 20429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:07.779299 20429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "4f63dad479184ddb8146228e65570165"
format_stamp: "Formatted at 2026-08-06 10:41:07 on dist-test-slave-fgb3"
server_key: "4574acfdea143776b1851991949ef885"
server_key_iv: "364ef8d1f6b8671ddd4c4c43d4f67740"
server_key_version: "encryptionkey@0"
I20260806 10:41:07.780109 20429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "4f63dad479184ddb8146228e65570165"
format_stamp: "Formatted at 2026-08-06 10:41:07 on dist-test-slave-fgb3"
server_key: "4574acfdea143776b1851991949ef885"
server_key_iv: "364ef8d1f6b8671ddd4c4c43d4f67740"
server_key_version: "encryptionkey@0"
I20260806 10:41:07.784967 20429 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 10:41:07.788264 20450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:07.789527 20429 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:41:07.789673 20429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "4f63dad479184ddb8146228e65570165"
format_stamp: "Formatted at 2026-08-06 10:41:07 on dist-test-slave-fgb3"
server_key: "4574acfdea143776b1851991949ef885"
server_key_iv: "364ef8d1f6b8671ddd4c4c43d4f67740"
server_key_version: "encryptionkey@0"
I20260806 10:41:07.789861 20429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:07.816063 20429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:07.820344 20429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:07.820634 20429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:07.821592 20429 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:07.822907 20429 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:07.822983 20429 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:07.823065 20429 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:07.823108 20429 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:07.855430 20429 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:35515
I20260806 10:41:07.855505 20626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:35515 every 8 connection(s)
I20260806 10:41:07.856796 20429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:41:07.861688 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 20429
I20260806 10:41:07.861929 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:41:07.862759 16565 external_mini_cluster.cc:1428] Setting key 6f5e86d7c03e1d5c9baf33bbbeb4d2af
Aug 06 10:41:07 dist-test-slave-fgb3 krb5kdc[20252](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012867, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:07.879186 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:07.859564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:59999 (local address 127.16.45.126:44353)
0806 10:41:07.860024 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:07.860031 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:07.861062 (+ 1031us) server_negotiation.cc:407] Connection header received
0806 10:41:07.863594 (+ 2532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:07.863599 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:07.863683 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:07.863788 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:07.865516 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:07.866233 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:07.868382 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:07.868837 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:07.868943 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:07.872761 (+ 3818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:07.872768 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:07.872773 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:07.872815 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:07.875889 (+ 3074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:07.876653 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:07.876659 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:07.876662 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:07.876806 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:07.877288 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:07.877294 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:07.877297 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:07.877642 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:07.877779 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:07.878597 (+ 818us) server_negotiation.cc:299] Negotiation successful
0806 10:41:07.878839 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":212,"threads_started":1}
I20260806 10:41:07.880000 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:07.860132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:44353 (local address 127.16.45.65:59999)
0806 10:41:07.860890 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:07.860940 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:07.863291 (+ 2351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:07.864034 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:07.864043 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:07.864553 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:07.865329 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:07.865357 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:07.866437 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:07.866442 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:07.868197 (+ 1755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:07.868213 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:07.869065 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:07.869073 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:07.869345 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:07.870039 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:07.870066 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:07.872526 (+ 2460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:07.876035 (+ 3509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:07.876043 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:07.876056 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:07.876519 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:07.876941 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:07.876945 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:07.876948 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:07.877150 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:07.877773 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:07.877779 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:07.878139 (+ 360us) client_negotiation.cc:769] Sending connection context
0806 10:41:07.878454 (+ 315us) client_negotiation.cc:240] Negotiation successful
0806 10:41:07.878877 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":262,"threads_started":1}
I20260806 10:41:07.881560 20627 heartbeater.cc:347] Connected to a master server at 127.16.45.126:44353
I20260806 10:41:07.881865 20627 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:07.882607 20627 heartbeater.cc:511] Master 127.16.45.126:44353 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
I20260806 10:41:07.884671 20327 ts_manager.cc:194] Registered new tserver with Master: 4f63dad479184ddb8146228e65570165 (127.16.45.65:35515)
I20260806 10:41:07.886150 20327 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:59999
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:41:07.911253 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44353
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:34269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:08.238762 20637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:08.239132 20637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:08.239274 20637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:08.246507 20637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:08.246646 20637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:08.246816 20637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:41:08.256675 20637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:08.258086 20637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:08.259493 20637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:08.272712 20649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:08.272639 20653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:08.272675 20650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:08.273416 20637 server_base.cc:1034] running on GCE node
I20260806 10:41:08.274044 20637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:08.275012 20637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:08.276243 20637 hybrid_clock.cc:648] HybridClock initialized: now 1786012868276184 us; error 48 us; skew 500 ppm
I20260806 10:41:08.276568 20637 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:08 dist-test-slave-fgb3 krb5kdc[20252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012868, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:08.279999 20637 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:41:08.281689 20637 webserver.cc:460] Webserver started at http://127.16.45.66:38643/ using document root <none> and password file <none>
I20260806 10:41:08.282563 20637 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:08.282697 20637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:08.283013 20637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:08.286927 20637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "4d68c174af914fa085b09991f7c8f7fd"
format_stamp: "Formatted at 2026-08-06 10:41:08 on dist-test-slave-fgb3"
server_key: "9ad3064a1c327a04014775af586a13de"
server_key_iv: "86db56a7feaf429688a73418e2056edb"
server_key_version: "encryptionkey@0"
I20260806 10:41:08.287912 20637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "4d68c174af914fa085b09991f7c8f7fd"
format_stamp: "Formatted at 2026-08-06 10:41:08 on dist-test-slave-fgb3"
server_key: "9ad3064a1c327a04014775af586a13de"
server_key_iv: "86db56a7feaf429688a73418e2056edb"
server_key_version: "encryptionkey@0"
I20260806 10:41:08.293728 20637 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260806 10:41:08.297326 20664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:08.298751 20637 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:08.298938 20637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "4d68c174af914fa085b09991f7c8f7fd"
format_stamp: "Formatted at 2026-08-06 10:41:08 on dist-test-slave-fgb3"
server_key: "9ad3064a1c327a04014775af586a13de"
server_key_iv: "86db56a7feaf429688a73418e2056edb"
server_key_version: "encryptionkey@0"
I20260806 10:41:08.299129 20637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:08.315408 20637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:08.319339 20637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:08.319607 20637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:08.320564 20637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:08.321871 20637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:08.321943 20637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:08.322057 20637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:08.322104 20637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:08.352253 20637 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:42275
I20260806 10:41:08.352289 20836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:42275 every 8 connection(s)
I20260806 10:41:08.353523 20637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:41:08.361565 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 20637
I20260806 10:41:08.361757 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:41:08.362213 16565 external_mini_cluster.cc:1428] Setting key b0f92c603618502e2b6d5f85724039f4
Aug 06 10:41:08 dist-test-slave-fgb3 krb5kdc[20252](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012868, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:08.373766 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:08.356013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:43887 (local address 127.16.45.126:44353)
0806 10:41:08.356236 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:08.356242 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:08.357404 (+ 1162us) server_negotiation.cc:407] Connection header received
0806 10:41:08.359337 (+ 1933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:08.359343 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:08.359428 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:08.359514 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:08.360900 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:08.361830 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:08.363532 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:08.364124 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:08.364250 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:08.368218 (+ 3968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:08.368224 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:08.368227 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:08.368258 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:08.370793 (+ 2535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:08.371566 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:08.371570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:08.371572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:08.371705 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:08.372113 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:08.372117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:08.372119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:08.372376 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:08.372513 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:08.373185 (+ 672us) server_negotiation.cc:299] Negotiation successful
0806 10:41:08.373423 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 10:41:08.374717 20840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:08.356479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:44353 (local address 127.16.45.66:43887)
0806 10:41:08.357181 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:08.357219 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:08.359069 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:08.359707 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:08.359714 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:08.360202 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:08.360765 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:08.360781 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:08.361994 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:08.361998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:08.363385 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:08.363397 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:08.364355 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:08.364363 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:08.364656 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:08.365324 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:08.365351 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:08.367990 (+ 2639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:08.370918 (+ 2928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:08.370927 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:08.370950 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:08.371441 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:08.371809 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:08.371813 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:08.371815 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:08.372002 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:08.372501 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:08.372509 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:08.372831 (+ 322us) client_negotiation.cc:769] Sending connection context
0806 10:41:08.373073 (+ 242us) client_negotiation.cc:240] Negotiation successful
0806 10:41:08.373577 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":272,"threads_started":1}
I20260806 10:41:08.376150 20837 heartbeater.cc:347] Connected to a master server at 127.16.45.126:44353
I20260806 10:41:08.376422 20837 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:08.377110 20837 heartbeater.cc:511] Master 127.16.45.126:44353 requested a full tablet report, sending...
I20260806 10:41:08.378592 20327 ts_manager.cc:194] Registered new tserver with Master: 4d68c174af914fa085b09991f7c8f7fd (127.16.45.66:42275)
I20260806 10:41:08.379359 20327 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:43887
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:41:08.407184 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44353
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:34269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:08.736028 20845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:08.736342 20845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:08.736485 20845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:08.743865 20845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:08.744004 20845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:08.744158 20845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:41:08.753933 20845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:08.755282 20845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:08.756636 20845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:08.769547 20858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:08.769701 20855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:08.769675 20851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:08.770648 20845 server_base.cc:1034] running on GCE node
I20260806 10:41:08.771252 20845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:08.772186 20845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:08.773415 20845 hybrid_clock.cc:648] HybridClock initialized: now 1786012868773361 us; error 39 us; skew 500 ppm
I20260806 10:41:08.773718 20845 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:08 dist-test-slave-fgb3 krb5kdc[20252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012868, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:08.776829 20845 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:41:08.778347 20845 webserver.cc:460] Webserver started at http://127.16.45.67:38705/ using document root <none> and password file <none>
I20260806 10:41:08.779029 20845 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:08.779138 20845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:08.779448 20845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:08.782410 20845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "7c278f8b2b984e69a870afee3457d9d4"
format_stamp: "Formatted at 2026-08-06 10:41:08 on dist-test-slave-fgb3"
server_key: "4b0a9db5266b010c3197357810152b96"
server_key_iv: "cfa61f9364b6b9559e3bedc76079d738"
server_key_version: "encryptionkey@0"
I20260806 10:41:08.783211 20845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "7c278f8b2b984e69a870afee3457d9d4"
format_stamp: "Formatted at 2026-08-06 10:41:08 on dist-test-slave-fgb3"
server_key: "4b0a9db5266b010c3197357810152b96"
server_key_iv: "cfa61f9364b6b9559e3bedc76079d738"
server_key_version: "encryptionkey@0"
I20260806 10:41:08.788344 20845 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:41:08.791932 20867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:08.793246 20845 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 10:41:08.793440 20845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "7c278f8b2b984e69a870afee3457d9d4"
format_stamp: "Formatted at 2026-08-06 10:41:08 on dist-test-slave-fgb3"
server_key: "4b0a9db5266b010c3197357810152b96"
server_key_iv: "cfa61f9364b6b9559e3bedc76079d738"
server_key_version: "encryptionkey@0"
I20260806 10:41:08.793640 20845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:08.816514 20845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:08.821004 20845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:08.821295 20845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:08.822346 20845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:08.823804 20845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:08.823891 20845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:08.824014 20845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:08.824069 20845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:08.855094 20845 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:37065
I20260806 10:41:08.855284 21048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:37065 every 8 connection(s)
I20260806 10:41:08.856410 20845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:41:08.866714 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 20845
I20260806 10:41:08.866921 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:41:08.867462 16565 external_mini_cluster.cc:1428] Setting key 6120b79f0c412b261bbd1f523a3f01bc
Aug 06 10:41:08 dist-test-slave-fgb3 krb5kdc[20252](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012868, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:08.876556 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:08.859075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:46873 (local address 127.16.45.126:44353)
0806 10:41:08.859238 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:08.859242 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:08.860657 (+ 1415us) server_negotiation.cc:407] Connection header received
0806 10:41:08.862513 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:08.862518 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:08.862592 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:08.862680 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:08.864155 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:08.864897 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:08.866517 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:08.867174 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:08.867321 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:08.871184 (+ 3863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:08.871189 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:08.871193 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:08.871227 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:08.873529 (+ 2302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:08.874328 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:08.874334 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:08.874339 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:08.874499 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:08.874935 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:08.874939 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:08.874941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:08.875254 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:08.875430 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:08.876108 (+ 678us) server_negotiation.cc:299] Negotiation successful
0806 10:41:08.876277 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 10:41:08.877503 21052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:08.859705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:44353 (local address 127.16.45.67:46873)
0806 10:41:08.860499 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:08.860535 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:08.862175 (+ 1640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:08.862892 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:08.862900 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:08.863409 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:08.863982 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:08.864000 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:08.865055 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:08.865059 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:08.866357 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:08.866375 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:08.867393 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:08.867398 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:08.867963 (+ 565us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:08.868639 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:08.868663 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:08.870992 (+ 2329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:08.873658 (+ 2666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:08.873666 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:08.873680 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:08.874141 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:08.874617 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:08.874620 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:08.874623 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:08.874820 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:08.875388 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:08.875394 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:08.875741 (+ 347us) client_negotiation.cc:769] Sending connection context
0806 10:41:08.875986 (+ 245us) client_negotiation.cc:240] Negotiation successful
0806 10:41:08.876405 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":322,"threads_started":1}
I20260806 10:41:08.878881 21050 heartbeater.cc:347] Connected to a master server at 127.16.45.126:44353
I20260806 10:41:08.879189 21050 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:08.879907 21050 heartbeater.cc:511] Master 127.16.45.126:44353 requested a full tablet report, sending...
I20260806 10:41:08.881479 20327 ts_manager.cc:194] Registered new tserver with Master: 7c278f8b2b984e69a870afee3457d9d4 (127.16.45.67:37065)
I20260806 10:41:08.882535 20327 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:46873
I20260806 10:41:08.883162 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:41:08.889111 20627 heartbeater.cc:503] Master 127.16.45.126:44353 was elected leader, sending a full tablet report...
W20260806 10:41:08.917243 20631 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:41:08.914869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54522 (local address 127.16.45.126:44353)
0806 10:41:08.915031 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:08.915036 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:08.915534 (+ 498us) server_negotiation.cc:407] Connection header received
0806 10:41:08.915704 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:08.915709 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:08.915779 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:08.915861 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:08.917007 (+ 1146us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54522: BlockingRecv error: recv got EOF from 127.0.0.1:54522 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 10:41:08.920327 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 20429
W20260806 10:41:08.923089 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 20429: Not authorized: Client connection negotiation failed: client connection to 127.16.45.65:35515: server requires authentication, but client does not have Kerberos credentials available
I20260806 10:41:08.923278 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 20429
I20260806 10:41:08.940167 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 20637
W20260806 10:41:08.942804 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 20637: Not authorized: Client connection negotiation failed: client connection to 127.16.45.66:42275: server requires authentication, but client does not have Kerberos credentials available
I20260806 10:41:08.942973 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 20637
I20260806 10:41:08.966423 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 20845
W20260806 10:41:08.969131 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 20845: Not authorized: Client connection negotiation failed: client connection to 127.16.45.67:37065: server requires authentication, but client does not have Kerberos credentials available
I20260806 10:41:08.969265 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 20845
I20260806 10:41:08.990232 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 20271
I20260806 10:41:08.991508 20380 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:09.095793 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 20271
2026-08-06T10:41:09Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3619 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:41:09 dist-test-slave-fgb3 krb5kdc[21076](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:41:09 dist-test-slave-fgb3 krb5kdc[21076](info): set up 2 sockets
Aug 06 10:41:09 dist-test-slave-fgb3 krb5kdc[21076](info): commencing operation
krb5kdc: starting...
W20260806 10:41:10.261523 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:41:10 dist-test-slave-fgb3 krb5kdc[21076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:41:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:41:10.464221 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:45635
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:33409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:45635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:10.777825 21101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:10.778122 21101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:10.778247 21101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:10.785729 21101 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:10.785832 21101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:10.785890 21101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:10.785966 21101 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:10.786028 21101 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:10.795639 21101 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:33409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:45635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:45635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:10.796814 21101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:10.798110 21101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:10.809151 21108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:10.809118 21111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:10.809118 21109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:10.809994 21101 server_base.cc:1034] running on GCE node
I20260806 10:41:10.810779 21101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:10.812021 21101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:10.813256 21101 hybrid_clock.cc:648] HybridClock initialized: now 1786012870813196 us; error 28 us; skew 500 ppm
I20260806 10:41:10.813578 21101 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:10 dist-test-slave-fgb3 krb5kdc[21076](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012870, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:10.819967 21101 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:41:10.821396 21101 webserver.cc:460] Webserver started at http://127.16.45.126:45445/ using document root <none> and password file <none>
I20260806 10:41:10.821993 21101 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:10.822091 21101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:10.822394 21101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:10.825220 21101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "60d359659df04bbba2024484f396f613"
format_stamp: "Formatted at 2026-08-06 10:41:10 on dist-test-slave-fgb3"
server_key: "fcc66a28061fd6c88bfe3bd075ce771d"
server_key_iv: "f4f5d47b8e039e6663b494ee7304a56e"
server_key_version: "encryptionkey@0"
I20260806 10:41:10.825937 21101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "60d359659df04bbba2024484f396f613"
format_stamp: "Formatted at 2026-08-06 10:41:10 on dist-test-slave-fgb3"
server_key: "fcc66a28061fd6c88bfe3bd075ce771d"
server_key_iv: "f4f5d47b8e039e6663b494ee7304a56e"
server_key_version: "encryptionkey@0"
I20260806 10:41:10.830775 21101 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 10:41:10.834021 21119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:10.835290 21101 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:10.835443 21101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "60d359659df04bbba2024484f396f613"
format_stamp: "Formatted at 2026-08-06 10:41:10 on dist-test-slave-fgb3"
server_key: "fcc66a28061fd6c88bfe3bd075ce771d"
server_key_iv: "f4f5d47b8e039e6663b494ee7304a56e"
server_key_version: "encryptionkey@0"
I20260806 10:41:10.835608 21101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:10.864470 21101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:10.868685 21101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:10.868947 21101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:10.886482 21101 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:45635
I20260806 10:41:10.886518 21199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:45635 every 8 connection(s)
I20260806 10:41:10.887809 21101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:10.891557 21201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:10.893764 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 21101
I20260806 10:41:10.894001 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:10.894838 16565 external_mini_cluster.cc:1428] Setting key d6ec40022c35fce2a1d411fa5fe45d37
I20260806 10:41:10.903954 21201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613: Bootstrap starting.
I20260806 10:41:10.907739 21201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:10.908996 21201 log.cc:824] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613: Log is configured to *not* fsync() on all Append() calls
Aug 06 10:41:10 dist-test-slave-fgb3 krb5kdc[21076](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:10.911863 21201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613: No bootstrap required, opened a new log
I20260806 10:41:10.917507 21204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:10.896849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43902 (local address 127.16.45.126:45635)
0806 10:41:10.897662 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:10.897674 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:10.897717 (+ 43us) server_negotiation.cc:407] Connection header received
0806 10:41:10.899385 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:10.899407 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:10.899790 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:10.900108 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:10.901866 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:10.903193 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:10.904897 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:10.905596 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:10.905734 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:10.910547 (+ 4813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:10.910554 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:10.910568 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:10.910603 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:10.913432 (+ 2829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:10.914107 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:10.914113 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:10.914130 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:10.914303 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:10.914766 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:10.914771 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:10.914774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:10.915356 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:10.915560 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:10.916067 (+ 507us) server_negotiation.cc:299] Negotiation successful
0806 10:41:10.916525 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":376,"threads_started":1}
I20260806 10:41:10.919978 21201 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d359659df04bbba2024484f396f613" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45635 } }
I20260806 10:41:10.920388 21201 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:10.920480 21201 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d359659df04bbba2024484f396f613, State: Initialized, Role: FOLLOWER
I20260806 10:41:10.921016 21201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d359659df04bbba2024484f396f613" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45635 } }
I20260806 10:41:10.921195 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:41:10.921303 21201 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:10.921429 21201 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:10.921576 21201 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:10.924535 21201 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d359659df04bbba2024484f396f613" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45635 } }
I20260806 10:41:10.925082 21201 leader_election.cc:302] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60d359659df04bbba2024484f396f613; no voters:
I20260806 10:41:10.925686 21201 leader_election.cc:288] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:10.925787 21208 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:10.931272 21208 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [term 1 LEADER]: Becoming Leader. State: Replica: 60d359659df04bbba2024484f396f613, State: Running, Role: LEADER
I20260806 10:41:10.931869 21208 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d359659df04bbba2024484f396f613" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45635 } }
I20260806 10:41:10.932153 21201 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:10.936069 21209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60d359659df04bbba2024484f396f613" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d359659df04bbba2024484f396f613" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45635 } } }
I20260806 10:41:10.936483 21209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:10.946885 21210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60d359659df04bbba2024484f396f613. Latest consensus state: current_term: 1 leader_uuid: "60d359659df04bbba2024484f396f613" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d359659df04bbba2024484f396f613" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45635 } } }
I20260806 10:41:10.947268 21210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:10.947419 21222 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:10.952533 21222 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:10.973892 21222 catalog_manager.cc:1347] Generated new cluster ID: 716dce88a5cf41d6bfdbb5412231266b
I20260806 10:41:10.974017 21222 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:10.984679 21240 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 10:41:10.985599 21222 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:10.987134 21222 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:10.996826 21204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:10.988031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43904 (local address 127.16.45.126:45635)
0806 10:41:10.988200 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:10.988206 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:10.988780 (+ 574us) server_negotiation.cc:407] Connection header received
0806 10:41:10.988961 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:10.988967 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:10.989050 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:10.989162 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:10.990499 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:10.991570 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:10.993392 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:10.994024 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:10.994132 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:10.995329 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:10.995335 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:10.995340 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:10.996058 (+ 718us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:10.996127 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:10.996162 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:10.996264 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:10.996418 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 10:41:10.996511 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 10:41:11.000124 21222 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60d359659df04bbba2024484f396f613: Generated new TSK 0
I20260806 10:41:11.000887 21222 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:41:11.008986 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 21101
I20260806 10:41:11.010434 21193 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:11.099464 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 21101
2026-08-06T10:41:11Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1999 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:41:11 dist-test-slave-fgb3 krb5kdc[21248](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:41:11 dist-test-slave-fgb3 krb5kdc[21248](info): set up 2 sockets
Aug 06 10:41:11 dist-test-slave-fgb3 krb5kdc[21248](info): commencing operation
krb5kdc: starting...
W20260806 10:41:12.275799 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.001s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:41:12 dist-test-slave-fgb3 krb5kdc[21248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:41:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:41:12.486304 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:44915
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:44725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:44915
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:12.804965 21276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:12.805266 21276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:12.805397 21276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:12.812664 21276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:12.812781 21276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:12.812839 21276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:12.812920 21276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:12.812978 21276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:12.822921 21276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:44725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:44915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:44915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:12.824273 21276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:12.825580 21276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:12.837231 21284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:12.837337 21285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:12.837252 21292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:12.837965 21276 server_base.cc:1034] running on GCE node
I20260806 10:41:12.838737 21276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:12.840097 21276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:12.841305 21276 hybrid_clock.cc:648] HybridClock initialized: now 1786012872841262 us; error 30 us; skew 500 ppm
I20260806 10:41:12.841617 21276 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:12 dist-test-slave-fgb3 krb5kdc[21248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012872, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:12.844583 21276 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:41:12.845950 21276 webserver.cc:460] Webserver started at http://127.16.45.126:43477/ using document root <none> and password file <none>
I20260806 10:41:12.846626 21276 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:12.846727 21276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:12.846985 21276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:12.849797 21276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "c2e02680814a4179871df6902272ceab"
format_stamp: "Formatted at 2026-08-06 10:41:12 on dist-test-slave-fgb3"
server_key: "2078d577fc314979a437d6e4df718729"
server_key_iv: "c44cd58626232008a053379097117f85"
server_key_version: "encryptionkey@0"
I20260806 10:41:12.850543 21276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "c2e02680814a4179871df6902272ceab"
format_stamp: "Formatted at 2026-08-06 10:41:12 on dist-test-slave-fgb3"
server_key: "2078d577fc314979a437d6e4df718729"
server_key_iv: "c44cd58626232008a053379097117f85"
server_key_version: "encryptionkey@0"
I20260806 10:41:12.855473 21276 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 10:41:12.858882 21305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:12.860327 21276 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 10:41:12.860507 21276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "c2e02680814a4179871df6902272ceab"
format_stamp: "Formatted at 2026-08-06 10:41:12 on dist-test-slave-fgb3"
server_key: "2078d577fc314979a437d6e4df718729"
server_key_iv: "c44cd58626232008a053379097117f85"
server_key_version: "encryptionkey@0"
I20260806 10:41:12.860711 21276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:12.886612 21276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:12.890595 21276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:12.890864 21276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:12.908427 21276 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:44915
I20260806 10:41:12.908497 21384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:44915 every 8 connection(s)
I20260806 10:41:12.909682 21276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:12.913398 21386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:12.916091 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 21276
I20260806 10:41:12.916266 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:12.916904 16565 external_mini_cluster.cc:1428] Setting key 0a52ff5dd61b63538e1dfccef55bad03
I20260806 10:41:12.926419 21386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab: Bootstrap starting.
I20260806 10:41:12.930029 21386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:12.931088 21386 log.cc:824] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab: Log is configured to *not* fsync() on all Append() calls
Aug 06 10:41:12 dist-test-slave-fgb3 krb5kdc[21248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:12.934589 21386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab: No bootstrap required, opened a new log
I20260806 10:41:12.941838 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:12.918855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44254 (local address 127.16.45.126:44915)
0806 10:41:12.919691 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:12.919707 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:12.919757 (+ 50us) server_negotiation.cc:407] Connection header received
0806 10:41:12.922023 (+ 2266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:12.922051 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:12.922579 (+ 528us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:12.923046 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:12.924238 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:12.926151 (+ 1913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:12.927440 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:12.928580 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:12.928776 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:12.932898 (+ 4122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:12.932911 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:12.932928 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:12.932983 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:12.937073 (+ 4090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:12.937787 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:12.937796 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:12.937806 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:12.938055 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:12.938457 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:12.938462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:12.938466 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:12.939194 (+ 728us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:12.939547 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:12.939881 (+ 334us) server_negotiation.cc:299] Negotiation successful
0806 10:41:12.940412 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":348,"threads_started":1}
I20260806 10:41:12.944828 21386 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e02680814a4179871df6902272ceab" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44915 } }
I20260806 10:41:12.945150 21386 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:12.945232 21386 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2e02680814a4179871df6902272ceab, State: Initialized, Role: FOLLOWER
I20260806 10:41:12.945709 21386 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e02680814a4179871df6902272ceab" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44915 } }
I20260806 10:41:12.945930 21386 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:12.946035 21386 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:12.946171 21386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:12.948405 21386 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e02680814a4179871df6902272ceab" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44915 } }
I20260806 10:41:12.948875 21386 leader_election.cc:302] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2e02680814a4179871df6902272ceab; no voters:
I20260806 10:41:12.949517 21386 leader_election.cc:288] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:12.949607 21394 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:12.950249 21394 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [term 1 LEADER]: Becoming Leader. State: Replica: c2e02680814a4179871df6902272ceab, State: Running, Role: LEADER
I20260806 10:41:12.950904 21394 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e02680814a4179871df6902272ceab" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44915 } }
I20260806 10:41:12.951834 21386 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:12.953601 21396 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2e02680814a4179871df6902272ceab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e02680814a4179871df6902272ceab" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44915 } } }
I20260806 10:41:12.953960 21396 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:12.953681 21395 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2e02680814a4179871df6902272ceab. Latest consensus state: current_term: 1 leader_uuid: "c2e02680814a4179871df6902272ceab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2e02680814a4179871df6902272ceab" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44915 } } }
I20260806 10:41:12.954219 21395 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:12.955859 21400 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:12.961786 21400 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:12.971544 21400 catalog_manager.cc:1347] Generated new cluster ID: a3c9972bd9274e459aac585bd280efca
I20260806 10:41:12.971655 21400 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:12.982779 21400 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:12.984036 21400 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:12.994889 21400 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2e02680814a4179871df6902272ceab: Generated new TSK 0
I20260806 10:41:12.995908 21400 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:41:13.054364 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44915
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:44725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:13.377575 21425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:13.377854 21425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:13.377992 21425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:13.385084 21425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:13.385205 21425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:13.385366 21425 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:41:13.394873 21425 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:44725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44915
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:13.396126 21425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:13.397387 21425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:13.409960 21432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:13.409910 21433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:13.410151 21436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:13.410624 21425 server_base.cc:1034] running on GCE node
I20260806 10:41:13.411170 21425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:13.412016 21425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:13.413211 21425 hybrid_clock.cc:648] HybridClock initialized: now 1786012873413159 us; error 47 us; skew 500 ppm
I20260806 10:41:13.413488 21425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:13 dist-test-slave-fgb3 krb5kdc[21248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012873, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:13.416599 21425 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:41:13.417943 21425 webserver.cc:460] Webserver started at http://127.16.45.65:35753/ using document root <none> and password file <none>
I20260806 10:41:13.418625 21425 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:13.418759 21425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:13.419044 21425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:13.421844 21425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "7ca27f1a35754979937856dfa20f594d"
format_stamp: "Formatted at 2026-08-06 10:41:13 on dist-test-slave-fgb3"
server_key: "c47d9513a1190ef4ee25baf43a97ac66"
server_key_iv: "5e109591e102cafc717c4253647e3752"
server_key_version: "encryptionkey@0"
I20260806 10:41:13.422626 21425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "7ca27f1a35754979937856dfa20f594d"
format_stamp: "Formatted at 2026-08-06 10:41:13 on dist-test-slave-fgb3"
server_key: "c47d9513a1190ef4ee25baf43a97ac66"
server_key_iv: "5e109591e102cafc717c4253647e3752"
server_key_version: "encryptionkey@0"
I20260806 10:41:13.427604 21425 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 10:41:13.431097 21446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:13.432400 21425 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:41:13.432559 21425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "7ca27f1a35754979937856dfa20f594d"
format_stamp: "Formatted at 2026-08-06 10:41:13 on dist-test-slave-fgb3"
server_key: "c47d9513a1190ef4ee25baf43a97ac66"
server_key_iv: "5e109591e102cafc717c4253647e3752"
server_key_version: "encryptionkey@0"
I20260806 10:41:13.432744 21425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:13.443738 21425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:13.447698 21425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:13.447968 21425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:13.448891 21425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:13.450181 21425 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:13.450258 21425 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:13.450443 21425 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:13.450498 21425 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:13.481567 21425 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:41481
I20260806 10:41:13.481590 21625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:41481 every 8 connection(s)
I20260806 10:41:13.482862 21425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:41:13.486580 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 21425
I20260806 10:41:13.486778 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:41:13.487406 16565 external_mini_cluster.cc:1428] Setting key ee57bf398b3324dec40f90de10bd864c
Aug 06 10:41:13 dist-test-slave-fgb3 krb5kdc[21248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012873, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:13.503489 21632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:13.485352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:52819 (local address 127.16.45.126:44915)
0806 10:41:13.485818 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:13.485823 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:13.486640 (+ 817us) server_negotiation.cc:407] Connection header received
0806 10:41:13.488734 (+ 2094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:13.488739 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:13.488801 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:13.488899 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:13.490456 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:13.491520 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:13.493100 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:13.493642 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:13.493757 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:13.497449 (+ 3692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:13.497464 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:13.497470 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:13.497516 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:13.500484 (+ 2968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:13.501181 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:13.501186 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:13.501189 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:13.501326 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:13.501725 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:13.501730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:13.501733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:13.502075 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:13.502206 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:13.502900 (+ 694us) server_negotiation.cc:299] Negotiation successful
0806 10:41:13.503145 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":241,"threads_started":1}
I20260806 10:41:13.504243 21633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:13.485742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:44915 (local address 127.16.45.65:52819)
0806 10:41:13.486486 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:13.486524 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:13.488459 (+ 1935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:13.489146 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:13.489157 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:13.489719 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:13.490254 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:13.490271 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:13.491689 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:13.491693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:13.492952 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:13.492969 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:13.493869 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:13.493876 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:13.494137 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:13.494821 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:13.494844 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:13.497147 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:13.500627 (+ 3480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:13.500634 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:13.500647 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:13.501053 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:13.501424 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:13.501427 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:13.501430 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:13.501604 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:13.502178 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:13.502184 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:13.502542 (+ 358us) client_negotiation.cc:769] Sending connection context
0806 10:41:13.502762 (+ 220us) client_negotiation.cc:240] Negotiation successful
0806 10:41:13.503139 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":290,"threads_started":1}
I20260806 10:41:13.505767 21629 heartbeater.cc:347] Connected to a master server at 127.16.45.126:44915
I20260806 10:41:13.506126 21629 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:13.507051 21629 heartbeater.cc:511] Master 127.16.45.126:44915 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
I20260806 10:41:13.509197 21330 ts_manager.cc:194] Registered new tserver with Master: 7ca27f1a35754979937856dfa20f594d (127.16.45.65:41481)
I20260806 10:41:13.510794 21330 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:52819
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:41:13.537536 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44915
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:44725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:13.854933 21640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:13.855223 21640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:13.855371 21640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:13.862958 21640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:13.863080 21640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:13.863232 21640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:41:13.873143 21640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:44725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44915
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:13.874512 21640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:13.875831 21640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:13.888648 21647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:13.888672 21646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:13.888703 21649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:13.889482 21640 server_base.cc:1034] running on GCE node
I20260806 10:41:13.890084 21640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:13.891006 21640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:13.892199 21640 hybrid_clock.cc:648] HybridClock initialized: now 1786012873892149 us; error 38 us; skew 500 ppm
I20260806 10:41:13.892496 21640 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:13 dist-test-slave-fgb3 krb5kdc[21248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012873, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:13.895759 21640 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:41:13.897181 21640 webserver.cc:460] Webserver started at http://127.16.45.66:46511/ using document root <none> and password file <none>
I20260806 10:41:13.897846 21640 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:13.897987 21640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:13.898279 21640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:13.901175 21640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "c8ff52f3ebee4e089d509d8f8c428a7a"
format_stamp: "Formatted at 2026-08-06 10:41:13 on dist-test-slave-fgb3"
server_key: "efd7bee1269b1ad15eaea15207c6e65c"
server_key_iv: "39a2ddf29efa7a84f9150ae00d2a8652"
server_key_version: "encryptionkey@0"
I20260806 10:41:13.901939 21640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "c8ff52f3ebee4e089d509d8f8c428a7a"
format_stamp: "Formatted at 2026-08-06 10:41:13 on dist-test-slave-fgb3"
server_key: "efd7bee1269b1ad15eaea15207c6e65c"
server_key_iv: "39a2ddf29efa7a84f9150ae00d2a8652"
server_key_version: "encryptionkey@0"
I20260806 10:41:13.906965 21640 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260806 10:41:13.910846 21665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:13.912290 21640 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:41:13.912449 21640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "c8ff52f3ebee4e089d509d8f8c428a7a"
format_stamp: "Formatted at 2026-08-06 10:41:13 on dist-test-slave-fgb3"
server_key: "efd7bee1269b1ad15eaea15207c6e65c"
server_key_iv: "39a2ddf29efa7a84f9150ae00d2a8652"
server_key_version: "encryptionkey@0"
I20260806 10:41:13.912648 21640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:13.931463 21640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:13.935123 21640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:13.935360 21640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:13.936352 21640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:13.937726 21640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:13.937805 21640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:13.937930 21640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:13.937995 21640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:13.965579 21640 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:40877
I20260806 10:41:13.965647 21840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:40877 every 8 connection(s)
I20260806 10:41:13.966821 21640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:41:13.967289 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 21640
I20260806 10:41:13.967481 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:41:13.968017 16565 external_mini_cluster.cc:1428] Setting key c5fd94cb0cb130fb74848b782deccc76
Aug 06 10:41:13 dist-test-slave-fgb3 krb5kdc[21248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012873, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:13.988479 21632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:13.969696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:53561 (local address 127.16.45.126:44915)
0806 10:41:13.969878 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:13.969883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:13.971080 (+ 1197us) server_negotiation.cc:407] Connection header received
0806 10:41:13.973433 (+ 2353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:13.973437 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:13.973501 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:13.973580 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:13.975481 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:13.976187 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:13.978247 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:13.978713 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:13.978825 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:13.982745 (+ 3920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:13.982750 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:13.982754 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:13.982787 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:13.985328 (+ 2541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:13.986183 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:13.986187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:13.986189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:13.986342 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:13.986807 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:13.986810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:13.986812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:13.987080 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:13.987203 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:13.988047 (+ 844us) server_negotiation.cc:299] Negotiation successful
0806 10:41:13.988230 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 10:41:13.989912 21844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:13.970098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:44915 (local address 127.16.45.66:53561)
0806 10:41:13.970914 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:13.970961 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:13.973152 (+ 2191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:13.973836 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:13.973846 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:13.974555 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:13.975316 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:13.975340 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:13.976343 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:13.976348 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:13.978104 (+ 1756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:13.978120 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:13.978944 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:13.978953 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:13.979169 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:13.979837 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:13.979884 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:13.982526 (+ 2642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:13.985464 (+ 2938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:13.985473 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:13.985489 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:13.986047 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:13.986457 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:13.986462 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:13.986466 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:13.986707 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:13.987203 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:13.987211 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:13.987651 (+ 440us) client_negotiation.cc:769] Sending connection context
0806 10:41:13.987965 (+ 314us) client_negotiation.cc:240] Negotiation successful
0806 10:41:13.988504 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":312,"threads_started":1}
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
I20260806 10:41:13.991386 21842 heartbeater.cc:347] Connected to a master server at 127.16.45.126:44915
I20260806 10:41:13.991679 21842 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:13.992399 21842 heartbeater.cc:511] Master 127.16.45.126:44915 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
I20260806 10:41:13.993829 21330 ts_manager.cc:194] Registered new tserver with Master: c8ff52f3ebee4e089d509d8f8c428a7a (127.16.45.66:40877)
I20260806 10:41:13.994671 21330 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:53561
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:41:14.016947 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44915
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:44725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:14.339468 21847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:14.339748 21847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:14.339859 21847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:14.346968 21847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:14.347074 21847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:14.347218 21847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:41:14.356830 21847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:44725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44915
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:14.358177 21847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:14.359469 21847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:14.372195 21853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:14.372140 21854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:14.372190 21856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:14.373080 21847 server_base.cc:1034] running on GCE node
I20260806 10:41:14.373627 21847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:14.374503 21847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:14.375710 21847 hybrid_clock.cc:648] HybridClock initialized: now 1786012874375654 us; error 44 us; skew 500 ppm
I20260806 10:41:14.375998 21847 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:14 dist-test-slave-fgb3 krb5kdc[21248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012874, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:14.379029 21847 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:41:14.380441 21847 webserver.cc:460] Webserver started at http://127.16.45.67:44499/ using document root <none> and password file <none>
I20260806 10:41:14.381062 21847 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:14.381165 21847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:14.381423 21847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:14.384250 21847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "97deedca32fd4266a8d9829af98cf3db"
format_stamp: "Formatted at 2026-08-06 10:41:14 on dist-test-slave-fgb3"
server_key: "f3586aa43464cb1b69b2a8e080c7962b"
server_key_iv: "bb12f98a0b89f00adfb777eac52e0e1e"
server_key_version: "encryptionkey@0"
I20260806 10:41:14.384974 21847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "97deedca32fd4266a8d9829af98cf3db"
format_stamp: "Formatted at 2026-08-06 10:41:14 on dist-test-slave-fgb3"
server_key: "f3586aa43464cb1b69b2a8e080c7962b"
server_key_iv: "bb12f98a0b89f00adfb777eac52e0e1e"
server_key_version: "encryptionkey@0"
I20260806 10:41:14.390044 21847 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 10:41:14.393353 21867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:14.394731 21847 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:14.394889 21847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "97deedca32fd4266a8d9829af98cf3db"
format_stamp: "Formatted at 2026-08-06 10:41:14 on dist-test-slave-fgb3"
server_key: "f3586aa43464cb1b69b2a8e080c7962b"
server_key_iv: "bb12f98a0b89f00adfb777eac52e0e1e"
server_key_version: "encryptionkey@0"
I20260806 10:41:14.395064 21847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:14.411577 21847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:14.415356 21847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:14.415632 21847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:14.416570 21847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:14.417968 21847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:14.418054 21847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:14.418184 21847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:14.418232 21847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:14.449060 21847 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:41945
I20260806 10:41:14.449100 22049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:41945 every 8 connection(s)
I20260806 10:41:14.450300 21847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:41:14.458077 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 21847
I20260806 10:41:14.458225 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:41:14.458662 16565 external_mini_cluster.cc:1428] Setting key d972408e1e4ee131439882caaaedbc01
Aug 06 10:41:14 dist-test-slave-fgb3 krb5kdc[21248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012874, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:14.469156 21632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:14.452726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:53553 (local address 127.16.45.126:44915)
0806 10:41:14.452914 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:14.452920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:14.454087 (+ 1167us) server_negotiation.cc:407] Connection header received
0806 10:41:14.455852 (+ 1765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:14.455858 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:14.455946 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:14.456033 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:14.457460 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:14.458267 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:14.459791 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:14.460242 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:14.460347 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:14.463938 (+ 3591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:14.463944 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:14.463947 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:14.463980 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:14.466552 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:14.467160 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:14.467164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:14.467166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:14.467303 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:14.467663 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:14.467668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:14.467670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:14.467974 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:14.468091 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:14.468735 (+ 644us) server_negotiation.cc:299] Negotiation successful
0806 10:41:14.468915 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 10:41:14.470129 22052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:14.453193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:44915 (local address 127.16.45.67:53553)
0806 10:41:14.453927 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:14.453965 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:14.455600 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:14.456276 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:14.456284 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:14.456760 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:14.457293 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:14.457309 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:14.458421 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:14.458425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:14.459648 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:14.459661 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:14.460453 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:14.460461 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:14.460692 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:14.461451 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:14.461482 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:14.463731 (+ 2249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:14.466662 (+ 2931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:14.466668 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:14.466680 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:14.467075 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:14.467377 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:14.467379 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:14.467382 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:14.467546 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:14.468081 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:14.468087 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:14.468382 (+ 295us) client_negotiation.cc:769] Sending connection context
0806 10:41:14.468655 (+ 273us) client_negotiation.cc:240] Negotiation successful
0806 10:41:14.469034 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":266,"threads_started":1}
I20260806 10:41:14.471566 22050 heartbeater.cc:347] Connected to a master server at 127.16.45.126:44915
I20260806 10:41:14.471848 22050 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:14.472683 22050 heartbeater.cc:511] Master 127.16.45.126:44915 requested a full tablet report, sending...
I20260806 10:41:14.474159 21330 ts_manager.cc:194] Registered new tserver with Master: 97deedca32fd4266a8d9829af98cf3db (127.16.45.67:41945)
I20260806 10:41:14.474937 21330 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:53553
I20260806 10:41:14.485747 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:41:14.513911 21629 heartbeater.cc:503] Master 127.16.45.126:44915 was elected leader, sending a full tablet report...
Aug 06 10:41:14 dist-test-slave-fgb3 krb5kdc[21248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012874, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 10:41:14 dist-test-slave-fgb3 krb5kdc[21248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012874, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:14.536646 21632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:14.523106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41884 (local address 127.16.45.126:44915)
0806 10:41:14.523265 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:14.523272 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:14.523752 (+ 480us) server_negotiation.cc:407] Connection header received
0806 10:41:14.523933 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:14.523937 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:14.524002 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:14.524085 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:14.525435 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:14.526165 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:14.527431 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:14.527838 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:14.527949 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:14.531780 (+ 3831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:14.531785 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:14.531789 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:14.531825 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:14.534155 (+ 2330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:14.534814 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:14.534820 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:14.534823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:14.534964 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:14.535347 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:14.535350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:14.535352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:14.535670 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:14.535901 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:14.536231 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 10:41:14.536416 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260806 10:41:14.537240 21330 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41884
I20260806 10:41:14.539417 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 21425
Aug 06 10:41:14 dist-test-slave-fgb3 krb5kdc[21248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012874, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:41:14.554349 22071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:14.540388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37496 (local address 127.16.45.65:41481)
0806 10:41:14.540982 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:14.540989 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:14.541015 (+ 26us) server_negotiation.cc:407] Connection header received
0806 10:41:14.541071 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:14.541077 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:14.541281 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:14.541408 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:14.542536 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:14.543556 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:14.544758 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:14.545335 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:14.545456 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:14.549195 (+ 3739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:14.549207 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:14.549222 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:14.549261 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:14.551936 (+ 2675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:14.552578 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:14.552585 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:14.552587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:14.552717 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:14.553011 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:14.553014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:14.553016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:14.553412 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:14.553647 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:14.553817 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 10:41:14.554022 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":296,"threads_started":1}
W20260806 10:41:14.555612 21620 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:37496
W20260806 10:41:14.556650 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 21425: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:41:14.556836 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 21425
I20260806 10:41:14.575527 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 21640
Aug 06 10:41:14 dist-test-slave-fgb3 krb5kdc[21248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012874, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:41:14.593138 22074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:14.576350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41406 (local address 127.16.45.66:40877)
0806 10:41:14.576870 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:14.576877 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:14.576905 (+ 28us) server_negotiation.cc:407] Connection header received
0806 10:41:14.576968 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:14.576975 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:14.577192 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:14.577320 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:14.578628 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:14.579678 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:14.580925 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:14.581537 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:14.581674 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:14.586934 (+ 5260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:14.586951 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:14.586972 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:14.587015 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:14.590331 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:14.591006 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:14.591016 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:14.591020 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:14.591150 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:14.591500 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:14.591505 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:14.591509 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:14.591872 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:14.592175 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:14.592493 (+ 318us) server_negotiation.cc:299] Negotiation successful
0806 10:41:14.592773 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":244,"threads_started":1}
W20260806 10:41:14.594480 21833 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41406
W20260806 10:41:14.595559 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 21640: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:41:14.595700 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 21640
I20260806 10:41:14.628412 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 21847
Aug 06 10:41:14 dist-test-slave-fgb3 krb5kdc[21248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012874, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:41:14.644829 22076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:14.629526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38238 (local address 127.16.45.67:41945)
0806 10:41:14.630159 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:14.630167 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:14.630195 (+ 28us) server_negotiation.cc:407] Connection header received
0806 10:41:14.630259 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:14.630265 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:14.630534 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:14.630663 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:14.632032 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:14.633114 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:14.634439 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:14.635016 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:14.635132 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:14.639542 (+ 4410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:14.639554 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:14.639569 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:14.639605 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:14.642451 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:14.643044 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:14.643050 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:14.643053 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:14.643174 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:14.643456 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:14.643460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:14.643462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:14.643802 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:14.644021 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:14.644267 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 10:41:14.644471 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":340,"threads_started":1}
W20260806 10:41:14.646113 22039 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38238
W20260806 10:41:14.647203 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 21847: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:41:14.647372 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 21847
I20260806 10:41:14.673007 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 21276
I20260806 10:41:14.674248 21379 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:14.775978 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 21276
2026-08-06T10:41:14Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3684 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:41:14 dist-test-slave-fgb3 krb5kdc[22083](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:41:14 dist-test-slave-fgb3 krb5kdc[22083](info): set up 2 sockets
Aug 06 10:41:14 dist-test-slave-fgb3 krb5kdc[22083](info): commencing operation
krb5kdc: starting...
W20260806 10:41:15.947001 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.003s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:41:16 dist-test-slave-fgb3 krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:41:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:41:16.162075 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:33541
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:33541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:16.483836 22100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:16.484128 22100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:16.484300 22100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:16.491820 22100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:16.491926 22100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:16.491984 22100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:16.492069 22100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:16.492120 22100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:16.502365 22100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:33541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:33541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:16.503679 22100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:16.504958 22100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:16.516369 22110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:16.516469 22116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:16.516374 22112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:16.516973 22100 server_base.cc:1034] running on GCE node
I20260806 10:41:16.517704 22100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:16.519088 22100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:16.520318 22100 hybrid_clock.cc:648] HybridClock initialized: now 1786012876520239 us; error 36 us; skew 500 ppm
I20260806 10:41:16.520637 22100 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:16 dist-test-slave-fgb3 krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012876, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:16.529049 22100 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:41:16.530550 22100 webserver.cc:460] Webserver started at http://127.16.45.126:43523/ using document root <none> and password file <none>
I20260806 10:41:16.531227 22100 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:16.531337 22100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:16.531656 22100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:16.534687 22100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "3c754717fd174e6593d04ce3858f818f"
format_stamp: "Formatted at 2026-08-06 10:41:16 on dist-test-slave-fgb3"
server_key: "b04ff1d8986947cd2c4b9ddb7e1da8ae"
server_key_iv: "63804d08c7c45e8072113bac8d18d8fa"
server_key_version: "encryptionkey@0"
I20260806 10:41:16.535604 22100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "3c754717fd174e6593d04ce3858f818f"
format_stamp: "Formatted at 2026-08-06 10:41:16 on dist-test-slave-fgb3"
server_key: "b04ff1d8986947cd2c4b9ddb7e1da8ae"
server_key_iv: "63804d08c7c45e8072113bac8d18d8fa"
server_key_version: "encryptionkey@0"
I20260806 10:41:16.541013 22100 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 10:41:16.544550 22132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:16.545866 22100 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:41:16.546010 22100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "3c754717fd174e6593d04ce3858f818f"
format_stamp: "Formatted at 2026-08-06 10:41:16 on dist-test-slave-fgb3"
server_key: "b04ff1d8986947cd2c4b9ddb7e1da8ae"
server_key_iv: "63804d08c7c45e8072113bac8d18d8fa"
server_key_version: "encryptionkey@0"
I20260806 10:41:16.546170 22100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:16.561551 22100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:16.565510 22100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:16.565737 22100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:16.582985 22100 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:33541
I20260806 10:41:16.583029 22211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:33541 every 8 connection(s)
I20260806 10:41:16.584285 22100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:16.587909 22212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:16.593039 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 22100
I20260806 10:41:16.593241 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:16.593871 16565 external_mini_cluster.cc:1428] Setting key 9a65dbf2b2436de70661b7f154378284
I20260806 10:41:16.599121 22212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f: Bootstrap starting.
I20260806 10:41:16.602697 22212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:16.603857 22212 log.cc:824] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:16.606531 22212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f: No bootstrap required, opened a new log
Aug 06 10:41:16 dist-test-slave-fgb3 krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:16.614264 22212 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c754717fd174e6593d04ce3858f818f" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33541 } }
I20260806 10:41:16.614670 22212 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:16.614775 22212 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c754717fd174e6593d04ce3858f818f, State: Initialized, Role: FOLLOWER
I20260806 10:41:16.615458 22212 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c754717fd174e6593d04ce3858f818f" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33541 } }
I20260806 10:41:16.615742 22212 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:16.615891 22212 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:16.616071 22212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:16.617000 22215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:16.595786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44136 (local address 127.16.45.126:33541)
0806 10:41:16.596670 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:16.596685 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:16.596742 (+ 57us) server_negotiation.cc:407] Connection header received
0806 10:41:16.599075 (+ 2333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:16.599109 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:16.599591 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:16.600039 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:16.601463 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:16.603416 (+ 1953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:16.604796 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:16.605451 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:16.605618 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:16.609555 (+ 3937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:16.609562 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:16.609575 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:16.609612 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:16.612711 (+ 3099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:16.613354 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:16.613360 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:16.613366 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:16.613543 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:16.613908 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:16.613912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:16.613914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:16.614483 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:16.614759 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:16.615189 (+ 430us) server_negotiation.cc:299] Negotiation successful
0806 10:41:16.615626 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":364,"threads_started":1}
I20260806 10:41:16.618726 22212 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c754717fd174e6593d04ce3858f818f" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33541 } }
I20260806 10:41:16.619211 22212 leader_election.cc:302] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c754717fd174e6593d04ce3858f818f; no voters:
I20260806 10:41:16.619819 22212 leader_election.cc:288] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:16.619915 22222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:16.620580 22222 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [term 1 LEADER]: Becoming Leader. State: Replica: 3c754717fd174e6593d04ce3858f818f, State: Running, Role: LEADER
I20260806 10:41:16.621105 22222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c754717fd174e6593d04ce3858f818f" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33541 } }
I20260806 10:41:16.621819 22212 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:16.623550 22224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c754717fd174e6593d04ce3858f818f. Latest consensus state: current_term: 1 leader_uuid: "3c754717fd174e6593d04ce3858f818f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c754717fd174e6593d04ce3858f818f" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33541 } } }
I20260806 10:41:16.624011 22224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:16.624825 22223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c754717fd174e6593d04ce3858f818f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c754717fd174e6593d04ce3858f818f" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33541 } } }
I20260806 10:41:16.626775 22223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:16.627614 22231 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:16.635432 22231 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:16.644071 22231 catalog_manager.cc:1347] Generated new cluster ID: e4e3a51a2be647f2b68f55e2cf32dd66
I20260806 10:41:16.644197 22231 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:16.658401 22231 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:16.659621 22231 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:16.671865 22231 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c754717fd174e6593d04ce3858f818f: Generated new TSK 0
I20260806 10:41:16.672686 22231 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:41:16.722437 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33541
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:17.048090 22248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:17.048398 22248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:17.048496 22248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:17.056056 22248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:17.056181 22248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:17.056298 22248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:41:17.066250 22248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:17.067584 22248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:17.069335 22248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:17.083166 22261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:17.083205 22256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:17.083138 22255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:17.083900 22248 server_base.cc:1034] running on GCE node
I20260806 10:41:17.084513 22248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:17.085525 22248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:17.086727 22248 hybrid_clock.cc:648] HybridClock initialized: now 1786012877086680 us; error 37 us; skew 500 ppm
I20260806 10:41:17.087062 22248 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:17 dist-test-slave-fgb3 krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012877, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:17.090551 22248 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:41:17.092216 22248 webserver.cc:460] Webserver started at http://127.16.45.65:45591/ using document root <none> and password file <none>
I20260806 10:41:17.093005 22248 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:17.093134 22248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:17.093451 22248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:17.096513 22248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "7145d1e44c3d4c82a535b50e5e6dee7e"
format_stamp: "Formatted at 2026-08-06 10:41:17 on dist-test-slave-fgb3"
server_key: "daad8fcddc1f79203ab50efcc1d21949"
server_key_iv: "1f5077efd040c7c9fc21f9375f8820c0"
server_key_version: "encryptionkey@0"
I20260806 10:41:17.097329 22248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "7145d1e44c3d4c82a535b50e5e6dee7e"
format_stamp: "Formatted at 2026-08-06 10:41:17 on dist-test-slave-fgb3"
server_key: "daad8fcddc1f79203ab50efcc1d21949"
server_key_iv: "1f5077efd040c7c9fc21f9375f8820c0"
server_key_version: "encryptionkey@0"
I20260806 10:41:17.102886 22248 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 10:41:17.106563 22277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:17.108114 22248 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:41:17.108306 22248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "7145d1e44c3d4c82a535b50e5e6dee7e"
format_stamp: "Formatted at 2026-08-06 10:41:17 on dist-test-slave-fgb3"
server_key: "daad8fcddc1f79203ab50efcc1d21949"
server_key_iv: "1f5077efd040c7c9fc21f9375f8820c0"
server_key_version: "encryptionkey@0"
I20260806 10:41:17.108536 22248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:17.122231 22248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:17.126463 22248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:17.126749 22248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:17.127712 22248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:17.129082 22248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:17.129161 22248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:17.129283 22248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:17.129336 22248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:17.160396 22248 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:34247
I20260806 10:41:17.160442 22442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:34247 every 8 connection(s)
I20260806 10:41:17.161653 22248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:41:17.164182 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 22248
I20260806 10:41:17.164453 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:41:17.165392 16565 external_mini_cluster.cc:1428] Setting key f087a5e7f635530a109f24d6ebf83363
Aug 06 10:41:17 dist-test-slave-fgb3 krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012877, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:17.182643 22445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:17.164361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:36207 (local address 127.16.45.126:33541)
0806 10:41:17.166401 (+ 2040us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:17.166406 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:17.166426 (+ 20us) server_negotiation.cc:407] Connection header received
0806 10:41:17.167954 (+ 1528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:17.167959 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:17.168053 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:17.168184 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:17.169696 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:17.170697 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:17.172405 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:17.172968 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:17.173091 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:17.176856 (+ 3765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:17.176861 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:17.176864 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:17.176898 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:17.179495 (+ 2597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:17.180241 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:17.180245 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:17.180248 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:17.180375 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:17.180805 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:17.180809 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:17.180811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:17.181104 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:17.181244 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:17.181980 (+ 736us) server_negotiation.cc:299] Negotiation successful
0806 10:41:17.182216 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1895,"thread_start_us":1784,"threads_started":1}
I20260806 10:41:17.183714 22447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:17.164824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33541 (local address 127.16.45.65:36207)
0806 10:41:17.165715 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:17.165761 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:17.167687 (+ 1926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:17.168381 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:17.168389 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:17.168912 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:17.169527 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:17.169548 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:17.170865 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:17.170870 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:17.172260 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:17.172274 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:17.173180 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:17.173185 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:17.173417 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:17.174129 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:17.174158 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:17.176623 (+ 2465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:17.179640 (+ 3017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:17.179650 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:17.179668 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:17.180115 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:17.180484 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:17.180489 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:17.180493 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:17.180690 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:17.181239 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:17.181248 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:17.181619 (+ 371us) client_negotiation.cc:769] Sending connection context
0806 10:41:17.181869 (+ 250us) client_negotiation.cc:240] Negotiation successful
0806 10:41:17.182478 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":313,"threads_started":1}
I20260806 10:41:17.185391 22443 heartbeater.cc:347] Connected to a master server at 127.16.45.126:33541
I20260806 10:41:17.185704 22443 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:17.186484 22443 heartbeater.cc:511] Master 127.16.45.126:33541 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
I20260806 10:41:17.188621 22154 ts_manager.cc:194] Registered new tserver with Master: 7145d1e44c3d4c82a535b50e5e6dee7e (127.16.45.65:34247)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
I20260806 10:41:17.190423 22154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:36207
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:41:17.218086 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33541
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:17.541045 22454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:17.541356 22454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:17.541453 22454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:17.548911 22454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:17.549027 22454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:17.549145 22454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:41:17.559332 22454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:17.560665 22454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:17.562008 22454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:17.576485 22462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:17.576503 22465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:17.576591 22460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:17.580090 22454 server_base.cc:1034] running on GCE node
I20260806 10:41:17.580780 22454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:17.581759 22454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:17.582998 22454 hybrid_clock.cc:648] HybridClock initialized: now 1786012877582930 us; error 52 us; skew 500 ppm
I20260806 10:41:17.583374 22454 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:17 dist-test-slave-fgb3 krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012877, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:17.586634 22454 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:41:17.588292 22454 webserver.cc:460] Webserver started at http://127.16.45.66:39015/ using document root <none> and password file <none>
I20260806 10:41:17.589071 22454 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:17.589180 22454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:17.589488 22454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:17.592478 22454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "2682bab4b5134bc580e1ad5d00e573e0"
format_stamp: "Formatted at 2026-08-06 10:41:17 on dist-test-slave-fgb3"
server_key: "752710d96d6fc393a099590db0a81aee"
server_key_iv: "f5fd35b2b0218fa18c6451434cd2514d"
server_key_version: "encryptionkey@0"
I20260806 10:41:17.593230 22454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "2682bab4b5134bc580e1ad5d00e573e0"
format_stamp: "Formatted at 2026-08-06 10:41:17 on dist-test-slave-fgb3"
server_key: "752710d96d6fc393a099590db0a81aee"
server_key_iv: "f5fd35b2b0218fa18c6451434cd2514d"
server_key_version: "encryptionkey@0"
I20260806 10:41:17.598649 22454 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 10:41:17.602210 22474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:17.603693 22454 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:41:17.603890 22454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "2682bab4b5134bc580e1ad5d00e573e0"
format_stamp: "Formatted at 2026-08-06 10:41:17 on dist-test-slave-fgb3"
server_key: "752710d96d6fc393a099590db0a81aee"
server_key_iv: "f5fd35b2b0218fa18c6451434cd2514d"
server_key_version: "encryptionkey@0"
I20260806 10:41:17.604104 22454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:17.620129 22454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:17.624548 22454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:17.624821 22454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:17.625819 22454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:17.627215 22454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:17.627288 22454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:17.627401 22454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:17.627456 22454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:17.659168 22454 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:34937
I20260806 10:41:17.659233 22647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:34937 every 8 connection(s)
I20260806 10:41:17.660530 22454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:41:17.670540 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 22454
I20260806 10:41:17.670717 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:41:17.671134 16565 external_mini_cluster.cc:1428] Setting key 5f0d3af34745e9b98ab373279a8230c4
Aug 06 10:41:17 dist-test-slave-fgb3 krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012877, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:17.680513 22445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:17.663042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:38367 (local address 127.16.45.126:33541)
0806 10:41:17.663209 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:17.663214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:17.664453 (+ 1239us) server_negotiation.cc:407] Connection header received
0806 10:41:17.666265 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:17.666271 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:17.666389 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:17.666482 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:17.667966 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:17.668687 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:17.670203 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:17.670693 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:17.670802 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:17.674954 (+ 4152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:17.674958 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:17.674961 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:17.674993 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:17.677382 (+ 2389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:17.678216 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:17.678220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:17.678222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:17.678382 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:17.678859 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:17.678863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:17.678866 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:17.679171 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:17.679299 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:17.680091 (+ 792us) server_negotiation.cc:299] Negotiation successful
0806 10:41:17.680273 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 10:41:17.681725 22652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:17.663575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33541 (local address 127.16.45.66:38367)
0806 10:41:17.664283 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:17.664321 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:17.665997 (+ 1676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:17.666726 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:17.666735 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:17.667231 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:17.667790 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:17.667807 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:17.668838 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:17.668842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:17.670064 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:17.670076 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:17.670922 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:17.670929 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:17.671145 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:17.671882 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:17.671935 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:17.674707 (+ 2772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:17.677511 (+ 2804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:17.677521 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:17.677536 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:17.678111 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:17.678479 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:17.678483 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:17.678486 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:17.678726 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:17.679304 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:17.679311 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:17.679721 (+ 410us) client_negotiation.cc:769] Sending connection context
0806 10:41:17.680014 (+ 293us) client_negotiation.cc:240] Negotiation successful
0806 10:41:17.680519 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":273,"threads_started":1}
I20260806 10:41:17.683099 22648 heartbeater.cc:347] Connected to a master server at 127.16.45.126:33541
I20260806 10:41:17.683408 22648 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:17.684105 22648 heartbeater.cc:511] Master 127.16.45.126:33541 requested a full tablet report, sending...
I20260806 10:41:17.685534 22154 ts_manager.cc:194] Registered new tserver with Master: 2682bab4b5134bc580e1ad5d00e573e0 (127.16.45.66:34937)
I20260806 10:41:17.686370 22154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:38367
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:41:17.722600 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33541
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:18.044739 22656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:18.045048 22656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:18.045169 22656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:18.052663 22656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:18.052775 22656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:18.052928 22656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:41:18.062790 22656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:18.064133 22656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:18.065526 22656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:18.078554 22663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:18.080497 22668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:18.080509 22664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:18.081022 22656 server_base.cc:1034] running on GCE node
I20260806 10:41:18.081646 22656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:18.082691 22656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:18.083926 22656 hybrid_clock.cc:648] HybridClock initialized: now 1786012878083870 us; error 45 us; skew 500 ppm
I20260806 10:41:18.084252 22656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:18 dist-test-slave-fgb3 krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012878, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:18.087590 22656 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:41:18.089280 22656 webserver.cc:460] Webserver started at http://127.16.45.67:35141/ using document root <none> and password file <none>
I20260806 10:41:18.090070 22656 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:18.090281 22656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:18.090667 22656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:18.093711 22656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "e05aaeada2824f3eb467888133c505cd"
format_stamp: "Formatted at 2026-08-06 10:41:18 on dist-test-slave-fgb3"
server_key: "a5ea9ad99ef4f523a49fc7be1b52dabc"
server_key_iv: "cdfdd8d24b221c7d963eff7aea8cb0c1"
server_key_version: "encryptionkey@0"
I20260806 10:41:18.094542 22656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "e05aaeada2824f3eb467888133c505cd"
format_stamp: "Formatted at 2026-08-06 10:41:18 on dist-test-slave-fgb3"
server_key: "a5ea9ad99ef4f523a49fc7be1b52dabc"
server_key_iv: "cdfdd8d24b221c7d963eff7aea8cb0c1"
server_key_version: "encryptionkey@0"
I20260806 10:41:18.099663 22656 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 10:41:18.103566 22676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:18.104945 22656 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 10:41:18.105127 22656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "e05aaeada2824f3eb467888133c505cd"
format_stamp: "Formatted at 2026-08-06 10:41:18 on dist-test-slave-fgb3"
server_key: "a5ea9ad99ef4f523a49fc7be1b52dabc"
server_key_iv: "cdfdd8d24b221c7d963eff7aea8cb0c1"
server_key_version: "encryptionkey@0"
I20260806 10:41:18.105341 22656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:18.124960 22656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:18.132351 22656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:18.132717 22656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:18.134120 22656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:18.136227 22656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:18.136337 22656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:18.136487 22656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:18.136557 22656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:18.178436 22656 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:38511
I20260806 10:41:18.178508 22843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:38511 every 8 connection(s)
I20260806 10:41:18.180146 22656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:41:18.184221 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 22656
I20260806 10:41:18.184456 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:41:18.185055 16565 external_mini_cluster.cc:1428] Setting key 8fc0b0f3b4dedf098eb5ed943178f096
I20260806 10:41:18.193531 22443 heartbeater.cc:503] Master 127.16.45.126:33541 was elected leader, sending a full tablet report...
Aug 06 10:41:18 dist-test-slave-fgb3 krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012878, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:18.201982 22849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:18.183329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:45599 (local address 127.16.45.126:33541)
0806 10:41:18.183801 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:18.183808 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:18.184913 (+ 1105us) server_negotiation.cc:407] Connection header received
0806 10:41:18.187210 (+ 2297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:18.187216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:18.187306 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:18.187399 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:18.189113 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.189902 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.191514 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.191928 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.192040 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:18.195848 (+ 3808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:18.195853 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:18.195857 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:18.195892 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:18.198738 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:18.199595 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:18.199601 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:18.199604 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:18.199764 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:18.200220 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:18.200223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:18.200226 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:18.200517 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:18.200650 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:18.201373 (+ 723us) server_negotiation.cc:299] Negotiation successful
0806 10:41:18.201604 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":221,"threads_started":1}
I20260806 10:41:18.203064 22850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:18.183880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33541 (local address 127.16.45.67:45599)
0806 10:41:18.184727 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:18.184781 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:18.186769 (+ 1988us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:18.187683 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:18.187692 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:18.188291 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:18.188950 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:18.188971 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.190062 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.190066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:18.191373 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:18.191386 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.192161 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.192168 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:18.192405 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:18.193065 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:18.193093 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:18.195624 (+ 2531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:18.198890 (+ 3266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:18.198901 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:18.198921 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:18.199458 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:18.199885 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:18.199890 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:18.199894 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:18.200096 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:18.200648 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:18.200656 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:18.201013 (+ 357us) client_negotiation.cc:769] Sending connection context
0806 10:41:18.201263 (+ 250us) client_negotiation.cc:240] Negotiation successful
0806 10:41:18.201834 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":374,"threads_started":1}
I20260806 10:41:18.204507 22846 heartbeater.cc:347] Connected to a master server at 127.16.45.126:33541
I20260806 10:41:18.204811 22846 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:18.205543 22846 heartbeater.cc:511] Master 127.16.45.126:33541 requested a full tablet report, sending...
I20260806 10:41:18.207054 22154 ts_manager.cc:194] Registered new tserver with Master: e05aaeada2824f3eb467888133c505cd (127.16.45.67:38511)
I20260806 10:41:18.207882 22154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:45599
I20260806 10:41:18.213284 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 10:41:18 dist-test-slave-fgb3 krb5kdc[22083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 10:41:18 dist-test-slave-fgb3 krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:41:18.267802 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:18.252709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57280 (local address 127.16.45.65:34247)
0806 10:41:18.253310 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:18.253317 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:18.253397 (+ 80us) server_negotiation.cc:407] Connection header received
0806 10:41:18.253465 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:18.253472 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:18.253680 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:18.253811 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:18.255248 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.256355 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.257542 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.258149 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.258255 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:18.262471 (+ 4216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:18.262483 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:18.262498 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:18.262535 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:18.265266 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:18.265870 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:18.265876 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:18.265879 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:18.266001 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:18.266389 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:18.266393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:18.266395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:18.266745 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:18.266976 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:18.267207 (+ 231us) server_negotiation.cc:299] Negotiation successful
0806 10:41:18.267440 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":296,"threads_started":1}
Aug 06 10:41:18 dist-test-slave-fgb3 krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:18.285571 22849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:18.272209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44146 (local address 127.16.45.126:33541)
0806 10:41:18.272432 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:18.272437 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:18.272568 (+ 131us) server_negotiation.cc:407] Connection header received
0806 10:41:18.272793 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:18.272797 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:18.272867 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:18.272956 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:18.274382 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.275119 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.276350 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.276783 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.276884 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:18.280619 (+ 3735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:18.280624 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:18.280628 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:18.280664 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:18.283222 (+ 2558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:18.283832 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:18.283836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:18.283838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:18.283959 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:18.284244 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:18.284247 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:18.284248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:18.284594 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:18.284779 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:18.285092 (+ 313us) server_negotiation.cc:299] Negotiation successful
0806 10:41:18.285264 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260806 10:41:18.286204 22154 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44146
I20260806 10:41:18.287216 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 22248
I20260806 10:41:18.300113 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:18.288045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57294 (local address 127.16.45.65:34247)
0806 10:41:18.288200 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:18.288204 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:18.288476 (+ 272us) server_negotiation.cc:407] Connection header received
0806 10:41:18.288600 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:18.288603 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:18.288665 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:18.288740 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:18.290118 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.290910 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.292195 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.292653 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.292745 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:18.295183 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:18.295189 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:18.295192 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:18.295226 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:18.297696 (+ 2470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:18.298399 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:18.298404 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:18.298407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:18.298557 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:18.298937 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:18.298940 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:18.298942 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:18.299198 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:18.299412 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:18.299691 (+ 279us) server_negotiation.cc:299] Negotiation successful
0806 10:41:18.299866 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 10:41:18.300690 22433 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:18.382835 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 22248
I20260806 10:41:18.404333 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 22454
Aug 06 10:41:18 dist-test-slave-fgb3 krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:41:18.419968 22867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:18.405176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59176 (local address 127.16.45.66:34937)
0806 10:41:18.405683 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:18.405690 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:18.405718 (+ 28us) server_negotiation.cc:407] Connection header received
0806 10:41:18.405780 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:18.405787 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:18.406028 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:18.406156 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:18.407412 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.408505 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.409783 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.410455 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.410560 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:18.414491 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:18.414504 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:18.414519 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:18.414555 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:18.417459 (+ 2904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:18.418068 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:18.418074 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:18.418077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:18.418201 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:18.418584 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:18.418589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:18.418591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:18.418964 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:18.419209 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:18.419467 (+ 258us) server_negotiation.cc:299] Negotiation successful
0806 10:41:18.419679 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":243,"threads_started":1}
I20260806 10:41:18.421278 22642 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:18.504035 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 22454
I20260806 10:41:18.523792 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 22656
Aug 06 10:41:18 dist-test-slave-fgb3 krb5kdc[22083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:41:18.539556 22870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:18.524804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55100 (local address 127.16.45.67:38511)
0806 10:41:18.525472 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:18.525479 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:18.525506 (+ 27us) server_negotiation.cc:407] Connection header received
0806 10:41:18.525570 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:18.525578 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:18.525775 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:18.525901 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:18.527215 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.528308 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.529502 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:18.530044 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:18.530138 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:18.534166 (+ 4028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:18.534180 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:18.534195 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:18.534229 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:18.536880 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:18.537509 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:18.537516 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:18.537518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:18.537640 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:18.537937 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:18.537940 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:18.537942 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:18.538289 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:18.538661 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:18.538955 (+ 294us) server_negotiation.cc:299] Negotiation successful
0806 10:41:18.539167 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":325,"threads_started":1}
I20260806 10:41:18.540926 22839 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:18.623203 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 22656
I20260806 10:41:18.640353 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 22100
I20260806 10:41:18.641585 22203 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:18.745113 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 22100
2026-08-06T10:41:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3968 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:41:18 dist-test-slave-fgb3 krb5kdc[22876](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:41:18 dist-test-slave-fgb3 krb5kdc[22876](info): set up 2 sockets
Aug 06 10:41:18 dist-test-slave-fgb3 krb5kdc[22876](info): commencing operation
krb5kdc: starting...
W20260806 10:41:19.923576 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.004s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:41:20 dist-test-slave-fgb3 krb5kdc[22876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:41:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:41:20.141534 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:34499
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:44721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:34499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:20.470852 22891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:20.471158 22891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:20.471292 22891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:20.478427 22891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:20.478540 22891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:20.478615 22891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:20.478691 22891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:20.478758 22891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:20.488518 22891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:44721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:34499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:34499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:20.489815 22891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:20.491156 22891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:20.502488 22900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:20.502509 22899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:20.502732 22905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:20.503547 22891 server_base.cc:1034] running on GCE node
I20260806 10:41:20.504333 22891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:20.505766 22891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:20.506966 22891 hybrid_clock.cc:648] HybridClock initialized: now 1786012880506913 us; error 42 us; skew 500 ppm
I20260806 10:41:20.507300 22891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:20 dist-test-slave-fgb3 krb5kdc[22876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012880, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:20.510545 22891 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:41:20.511772 22891 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:20.511873 22891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:20.512203 22891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:20.515245 22891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "0b927ab27005406796d9a8fa3b0c2262"
format_stamp: "Formatted at 2026-08-06 10:41:20 on dist-test-slave-fgb3"
server_key: "da71000fc76cd66b58f954225d0d374e"
server_key_iv: "23f94dacbe8c56eb66245467dda2ab12"
server_key_version: "encryptionkey@0"
I20260806 10:41:20.516052 22891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "0b927ab27005406796d9a8fa3b0c2262"
format_stamp: "Formatted at 2026-08-06 10:41:20 on dist-test-slave-fgb3"
server_key: "da71000fc76cd66b58f954225d0d374e"
server_key_iv: "23f94dacbe8c56eb66245467dda2ab12"
server_key_version: "encryptionkey@0"
I20260806 10:41:20.521130 22891 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:41:20.524406 22912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:20.525620 22891 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 10:41:20.525785 22891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "0b927ab27005406796d9a8fa3b0c2262"
format_stamp: "Formatted at 2026-08-06 10:41:20 on dist-test-slave-fgb3"
server_key: "da71000fc76cd66b58f954225d0d374e"
server_key_iv: "23f94dacbe8c56eb66245467dda2ab12"
server_key_version: "encryptionkey@0"
I20260806 10:41:20.525990 22891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:20.542794 22891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:20.546993 22891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:20.547250 22891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:20.564654 22891 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:34499
I20260806 10:41:20.564674 22991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:34499 every 8 connection(s)
I20260806 10:41:20.565567 22891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:20.569248 22992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:20.573083 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 22891
I20260806 10:41:20.573318 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:20.574105 16565 external_mini_cluster.cc:1428] Setting key f05b2a25ed46fc4172d37e0877271d64
I20260806 10:41:20.582785 22992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262: Bootstrap starting.
I20260806 10:41:20.586628 22992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:20.587977 22992 log.cc:824] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262: Log is configured to *not* fsync() on all Append() calls
Aug 06 10:41:20 dist-test-slave-fgb3 krb5kdc[22876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:20.591497 22992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262: No bootstrap required, opened a new log
I20260806 10:41:20.599160 22996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:20.576257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53134 (local address 127.16.45.126:34499)
0806 10:41:20.577071 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:20.577082 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:20.577124 (+ 42us) server_negotiation.cc:407] Connection header received
0806 10:41:20.578732 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:20.578756 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:20.579165 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:20.579496 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:20.581250 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:20.582706 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:20.584469 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:20.585231 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:20.585395 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:20.590289 (+ 4894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:20.590302 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:20.590344 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:20.590390 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:20.594269 (+ 3879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:20.595036 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:20.595045 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:20.595059 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:20.595277 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:20.595664 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:20.595672 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:20.595676 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:20.596430 (+ 754us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:20.596721 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:20.597197 (+ 476us) server_negotiation.cc:299] Negotiation successful
0806 10:41:20.597667 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":366,"threads_started":1}
I20260806 10:41:20.601647 22992 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b927ab27005406796d9a8fa3b0c2262" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34499 } }
I20260806 10:41:20.602089 22992 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:20.602214 22992 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b927ab27005406796d9a8fa3b0c2262, State: Initialized, Role: FOLLOWER
I20260806 10:41:20.602885 22992 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b927ab27005406796d9a8fa3b0c2262" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34499 } }
I20260806 10:41:20.603097 22992 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:20.603188 22992 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:20.603324 22992 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:20.605451 22992 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b927ab27005406796d9a8fa3b0c2262" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34499 } }
I20260806 10:41:20.605892 22992 leader_election.cc:302] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b927ab27005406796d9a8fa3b0c2262; no voters:
I20260806 10:41:20.606540 22992 leader_election.cc:288] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:20.606689 22999 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:20.607373 22999 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [term 1 LEADER]: Becoming Leader. State: Replica: 0b927ab27005406796d9a8fa3b0c2262, State: Running, Role: LEADER
I20260806 10:41:20.607908 22999 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b927ab27005406796d9a8fa3b0c2262" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34499 } }
I20260806 10:41:20.608772 22992 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:20.610975 23001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b927ab27005406796d9a8fa3b0c2262" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b927ab27005406796d9a8fa3b0c2262" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34499 } } }
I20260806 10:41:20.610949 23002 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b927ab27005406796d9a8fa3b0c2262. Latest consensus state: current_term: 1 leader_uuid: "0b927ab27005406796d9a8fa3b0c2262" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b927ab27005406796d9a8fa3b0c2262" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34499 } } }
I20260806 10:41:20.611343 23001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:20.611347 23002 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:20.613013 23007 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:20.618296 23007 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:20.626874 23007 catalog_manager.cc:1347] Generated new cluster ID: bf17c32939c54702bb3f0b1cd6abcebe
I20260806 10:41:20.626993 23007 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:20.641778 23007 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:20.643208 23007 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:20.650161 23007 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262: Generated new TSK 0
I20260806 10:41:20.651033 23007 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:41:20.710422 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34499
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:44721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:21.031296 23027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:21.031584 23027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:21.031709 23027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:21.038952 23027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:21.039070 23027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:21.039219 23027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:41:21.048961 23027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:44721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:21.050426 23027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:21.051759 23027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:21.064296 23036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:21.064244 23037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:21.064206 23040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:21.065179 23027 server_base.cc:1034] running on GCE node
I20260806 10:41:21.065769 23027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:21.066773 23027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:21.067986 23027 hybrid_clock.cc:648] HybridClock initialized: now 1786012881067936 us; error 42 us; skew 500 ppm
I20260806 10:41:21.068293 23027 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:21 dist-test-slave-fgb3 krb5kdc[22876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012881, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:21.071389 23027 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:41:21.072507 23027 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:21.072609 23027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:21.072919 23027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:21.075870 23027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "7c81993cbcd0439fbae535ee17c1e5fb"
format_stamp: "Formatted at 2026-08-06 10:41:21 on dist-test-slave-fgb3"
server_key: "fc0b002add190b714f5eeac660fd280c"
server_key_iv: "ffc0c1953d770ba40714ac92bb6f1dab"
server_key_version: "encryptionkey@0"
I20260806 10:41:21.076653 23027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "7c81993cbcd0439fbae535ee17c1e5fb"
format_stamp: "Formatted at 2026-08-06 10:41:21 on dist-test-slave-fgb3"
server_key: "fc0b002add190b714f5eeac660fd280c"
server_key_iv: "ffc0c1953d770ba40714ac92bb6f1dab"
server_key_version: "encryptionkey@0"
I20260806 10:41:21.081910 23027 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:41:21.086017 23050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:21.087580 23027 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260806 10:41:21.087757 23027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "7c81993cbcd0439fbae535ee17c1e5fb"
format_stamp: "Formatted at 2026-08-06 10:41:21 on dist-test-slave-fgb3"
server_key: "fc0b002add190b714f5eeac660fd280c"
server_key_iv: "ffc0c1953d770ba40714ac92bb6f1dab"
server_key_version: "encryptionkey@0"
I20260806 10:41:21.087991 23027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:21.114880 23027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:21.119273 23027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:21.119555 23027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:21.120577 23027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:21.121951 23027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:21.122051 23027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:21.122152 23027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:21.122220 23027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:21.153975 23027 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:40709
I20260806 10:41:21.154042 23221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:40709 every 8 connection(s)
I20260806 10:41:21.154932 23027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:41:21.164199 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 23027
I20260806 10:41:21.164440 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:41:21.165228 16565 external_mini_cluster.cc:1428] Setting key d6212a00f733215b6574c0ec4ad70226
Aug 06 10:41:21 dist-test-slave-fgb3 krb5kdc[22876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012881, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:21.175249 23224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:21.157331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:49343 (local address 127.16.45.126:34499)
0806 10:41:21.157734 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:21.157739 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:21.158708 (+ 969us) server_negotiation.cc:407] Connection header received
0806 10:41:21.160546 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:21.160552 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:21.160635 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:21.160732 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:21.162358 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:21.163097 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:21.165184 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:21.165678 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:21.165814 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:21.169668 (+ 3854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:21.169672 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:21.169676 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:21.169708 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:21.172232 (+ 2524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:21.172927 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:21.172931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:21.172934 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:21.173054 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:21.173476 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:21.173481 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:21.173483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:21.173762 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:21.173893 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:21.174649 (+ 756us) server_negotiation.cc:299] Negotiation successful
0806 10:41:21.174884 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":201,"threads_started":1}
I20260806 10:41:21.176221 23225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:21.157796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34499 (local address 127.16.45.65:49343)
0806 10:41:21.158549 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:21.158588 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:21.160267 (+ 1679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:21.160991 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:21.161000 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:21.161581 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:21.162160 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:21.162179 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:21.163267 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:21.163271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:21.164990 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:21.165006 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:21.165898 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:21.165903 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:21.166156 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:21.166877 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:21.166911 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:21.169452 (+ 2541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:21.172364 (+ 2912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:21.172374 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:21.172390 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:21.172811 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:21.173157 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:21.173162 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:21.173166 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:21.173361 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:21.173884 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:21.173892 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:21.174234 (+ 342us) client_negotiation.cc:769] Sending connection context
0806 10:41:21.174532 (+ 298us) client_negotiation.cc:240] Negotiation successful
0806 10:41:21.175080 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":319,"threads_started":1}
I20260806 10:41:21.177837 23222 heartbeater.cc:347] Connected to a master server at 127.16.45.126:34499
I20260806 10:41:21.178128 23222 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:21.178789 23222 heartbeater.cc:511] Master 127.16.45.126:34499 requested a full tablet report, sending...
I20260806 10:41:21.181036 22939 ts_manager.cc:194] Registered new tserver with Master: 7c81993cbcd0439fbae535ee17c1e5fb (127.16.45.65:40709)
I20260806 10:41:21.183022 22939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:49343
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:41:21.217852 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34499
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:44721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:21.535616 23228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:21.535921 23228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:21.536065 23228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:21.543288 23228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:21.543418 23228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:21.543572 23228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:41:21.553336 23228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:44721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:21.554733 23228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:21.556051 23228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:21.568964 23236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:21.569041 23240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:21.570143 23228 server_base.cc:1034] running on GCE node
W20260806 10:41:21.570856 23235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:21.571669 23228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:21.572890 23228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:21.574129 23228 hybrid_clock.cc:648] HybridClock initialized: now 1786012881574070 us; error 47 us; skew 500 ppm
I20260806 10:41:21.574548 23228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:21 dist-test-slave-fgb3 krb5kdc[22876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012881, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:21.582851 23228 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:41:21.584204 23228 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:21.584311 23228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:21.584592 23228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:21.587733 23228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "fde04170fc1f4c199a963f0c3340100b"
format_stamp: "Formatted at 2026-08-06 10:41:21 on dist-test-slave-fgb3"
server_key: "1234ae6fd1b9d0f81a329633fd27abb1"
server_key_iv: "257b230b04d7bf4ba031695186dad49f"
server_key_version: "encryptionkey@0"
I20260806 10:41:21.588541 23228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "fde04170fc1f4c199a963f0c3340100b"
format_stamp: "Formatted at 2026-08-06 10:41:21 on dist-test-slave-fgb3"
server_key: "1234ae6fd1b9d0f81a329633fd27abb1"
server_key_iv: "257b230b04d7bf4ba031695186dad49f"
server_key_version: "encryptionkey@0"
I20260806 10:41:21.593763 23228 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:41:21.597289 23251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:21.598775 23228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:21.598927 23228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "fde04170fc1f4c199a963f0c3340100b"
format_stamp: "Formatted at 2026-08-06 10:41:21 on dist-test-slave-fgb3"
server_key: "1234ae6fd1b9d0f81a329633fd27abb1"
server_key_iv: "257b230b04d7bf4ba031695186dad49f"
server_key_version: "encryptionkey@0"
I20260806 10:41:21.599123 23228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:21.614292 23228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:21.618304 23228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:21.618589 23228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:21.619599 23228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:21.621016 23228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:21.621105 23228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:21.621182 23228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:21.621237 23228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:21.652665 23228 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:44065
I20260806 10:41:21.652721 23416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:44065 every 8 connection(s)
I20260806 10:41:21.653525 23228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:41:21.659828 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 23228
I20260806 10:41:21.660017 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:41:21.660437 16565 external_mini_cluster.cc:1428] Setting key 381e8445fb93fad23018bc19d70d819b
Aug 06 10:41:21 dist-test-slave-fgb3 krb5kdc[22876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012881, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:21.673138 23224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:21.655917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:41515 (local address 127.16.45.126:34499)
0806 10:41:21.656091 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:21.656096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:21.657272 (+ 1176us) server_negotiation.cc:407] Connection header received
0806 10:41:21.659121 (+ 1849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:21.659127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:21.659214 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:21.659301 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:21.660893 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:21.661700 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:21.663351 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:21.663784 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:21.663894 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:21.667621 (+ 3727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:21.667626 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:21.667629 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:21.667661 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:21.670061 (+ 2400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:21.670863 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:21.670868 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:21.670872 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:21.671026 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:21.671444 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:21.671448 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:21.671451 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:21.671776 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:21.671914 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:21.672586 (+ 672us) server_negotiation.cc:299] Negotiation successful
0806 10:41:21.672800 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 10:41:21.673930 23419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:21.656361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34499 (local address 127.16.45.66:41515)
0806 10:41:21.657109 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:21.657150 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:21.658862 (+ 1712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:21.659556 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:21.659564 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:21.660140 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:21.660721 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:21.660740 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:21.661846 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:21.661851 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:21.663215 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:21.663228 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:21.663998 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:21.664006 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:21.664202 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:21.664834 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:21.664859 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:21.667410 (+ 2551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:21.670211 (+ 2801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:21.670217 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:21.670229 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:21.670738 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:21.671130 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:21.671133 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:21.671136 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:21.671332 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:21.671885 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:21.671890 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:21.672190 (+ 300us) client_negotiation.cc:769] Sending connection context
0806 10:41:21.672450 (+ 260us) client_negotiation.cc:240] Negotiation successful
0806 10:41:21.672837 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":341,"threads_started":1}
I20260806 10:41:21.675386 23417 heartbeater.cc:347] Connected to a master server at 127.16.45.126:34499
I20260806 10:41:21.675727 23417 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:21.676548 23417 heartbeater.cc:511] Master 127.16.45.126:34499 requested a full tablet report, sending...
I20260806 10:41:21.678113 22939 ts_manager.cc:194] Registered new tserver with Master: fde04170fc1f4c199a963f0c3340100b (127.16.45.66:44065)
I20260806 10:41:21.679051 22939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:41515
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:41:21.714267 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34499
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:44721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:22.046417 23428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:22.046752 23428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:22.046921 23428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:22.054596 23428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:22.054747 23428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:22.054920 23428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:41:22.065440 23428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:44721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:22.066887 23428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:22.068233 23428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:22.081324 23436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:22.081404 23443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:22.081373 23441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:22.082194 23428 server_base.cc:1034] running on GCE node
I20260806 10:41:22.082844 23428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:22.083779 23428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:22.084955 23428 hybrid_clock.cc:648] HybridClock initialized: now 1786012882084902 us; error 38 us; skew 500 ppm
I20260806 10:41:22.085268 23428 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:22 dist-test-slave-fgb3 krb5kdc[22876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012882, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:22.088922 23428 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:41:22.090090 23428 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:22.090193 23428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:22.090526 23428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:22.093545 23428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "6b906ebfde5b45f4b15218a824c32b63"
format_stamp: "Formatted at 2026-08-06 10:41:22 on dist-test-slave-fgb3"
server_key: "72dc9ba8007e81862e2e4f945ec71ae7"
server_key_iv: "637185aad19c7370e0a04de52d312e97"
server_key_version: "encryptionkey@0"
I20260806 10:41:22.094370 23428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "6b906ebfde5b45f4b15218a824c32b63"
format_stamp: "Formatted at 2026-08-06 10:41:22 on dist-test-slave-fgb3"
server_key: "72dc9ba8007e81862e2e4f945ec71ae7"
server_key_iv: "637185aad19c7370e0a04de52d312e97"
server_key_version: "encryptionkey@0"
I20260806 10:41:22.099370 23428 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 10:41:22.102896 23450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:22.104197 23428 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:41:22.104374 23428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "6b906ebfde5b45f4b15218a824c32b63"
format_stamp: "Formatted at 2026-08-06 10:41:22 on dist-test-slave-fgb3"
server_key: "72dc9ba8007e81862e2e4f945ec71ae7"
server_key_iv: "637185aad19c7370e0a04de52d312e97"
server_key_version: "encryptionkey@0"
I20260806 10:41:22.104575 23428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:22.144876 23428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:22.149304 23428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:22.149585 23428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:22.150652 23428 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:22.151995 23428 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:22.152091 23428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:22.152204 23428 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:22.152273 23428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:22.183586 23428 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:45583
I20260806 10:41:22.183637 23627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:45583 every 8 connection(s)
I20260806 10:41:22.184446 23428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:41:22.186461 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 23428
I20260806 10:41:22.186676 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:41:22.186626 23222 heartbeater.cc:503] Master 127.16.45.126:34499 was elected leader, sending a full tablet report...
I20260806 10:41:22.187233 16565 external_mini_cluster.cc:1428] Setting key 58f6b1822a54abac040465be74ed30cd
Aug 06 10:41:22 dist-test-slave-fgb3 krb5kdc[22876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012882, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:22.206512 23631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.187145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:58647 (local address 127.16.45.126:34499)
0806 10:41:22.190733 (+ 3588us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:22.190739 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:22.190761 (+ 22us) server_negotiation.cc:407] Connection header received
0806 10:41:22.190830 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:22.190835 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:22.190923 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:22.191058 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:22.192788 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.193990 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.195671 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.196132 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.196236 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.199996 (+ 3760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:22.200001 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:22.200005 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:22.200039 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:22.202730 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:22.203669 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:22.203673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:22.203675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:22.203811 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:22.204364 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:22.204368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:22.204370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:22.204690 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:22.204855 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:22.205839 (+ 984us) server_negotiation.cc:299] Negotiation successful
0806 10:41:22.206093 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3464,"thread_start_us":3332,"threads_started":1}
I20260806 10:41:22.207690 23632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.187764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34499 (local address 127.16.45.67:58647)
0806 10:41:22.188591 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.188646 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:22.190424 (+ 1778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:22.191306 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:22.191315 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:22.191875 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:22.192564 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:22.192584 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.194170 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.194176 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:22.195509 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:22.195528 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.196451 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.196462 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:22.196673 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.197415 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:22.197440 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:22.199774 (+ 2334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:22.202885 (+ 3111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:22.202893 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:22.202907 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:22.203519 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:22.203962 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:22.203966 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:22.203968 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:22.204173 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:22.204855 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:22.204864 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:22.205351 (+ 487us) client_negotiation.cc:769] Sending connection context
0806 10:41:22.205715 (+ 364us) client_negotiation.cc:240] Negotiation successful
0806 10:41:22.206293 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":334,"threads_started":1}
I20260806 10:41:22.209162 23629 heartbeater.cc:347] Connected to a master server at 127.16.45.126:34499
I20260806 10:41:22.209483 23629 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:22.210180 23629 heartbeater.cc:511] Master 127.16.45.126:34499 requested a full tablet report, sending...
I20260806 10:41:22.211674 22938 ts_manager.cc:194] Registered new tserver with Master: 6b906ebfde5b45f4b15218a824c32b63 (127.16.45.67:45583)
I20260806 10:41:22.212659 22938 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:58647
I20260806 10:41:22.219250 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:41:22.236233 23631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.223628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53138 (local address 127.16.45.126:34499)
0806 10:41:22.223791 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:22.223796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:22.224281 (+ 485us) server_negotiation.cc:407] Connection header received
0806 10:41:22.224444 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:22.224448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:22.224515 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:22.224596 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:22.226026 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.226827 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.228167 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.228681 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.228777 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.231088 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:22.231094 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:22.231097 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:22.231132 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:22.233673 (+ 2541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:22.234415 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:22.234420 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:22.234422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:22.234557 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:22.234916 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:22.234920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:22.234922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:22.235264 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:22.235461 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:22.235741 (+ 280us) server_negotiation.cc:299] Negotiation successful
0806 10:41:22.235926 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 10:41:22.240463 22938 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53138:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:41:22.247205 22938 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:22.283594 23656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.261310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58864 (local address 127.16.45.67:45583)
0806 10:41:22.274995 (+ 13685us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:22.275003 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:22.275037 (+ 34us) server_negotiation.cc:407] Connection header received
0806 10:41:22.275366 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:22.275374 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:22.275651 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:22.275863 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:22.277729 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.279110 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.281408 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.282373 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.282487 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.282739 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:22.283056 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 10:41:22.283232 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13512,"thread_start_us":13350,"threads_started":1}
I20260806 10:41:22.283663 23655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.260734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:45583 (local address 127.0.0.1:58864)
0806 10:41:22.274829 (+ 14095us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.274846 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:22.275048 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:22.276141 (+ 1093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:22.276149 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:22.276175 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:22.277469 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:22.277482 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.279257 (+ 1775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.279263 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:22.281264 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:22.281275 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.282581 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.282587 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:22.282839 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.282879 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 10:41:22.282993 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 10:41:22.283176 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13978,"mutex_wait_us":1,"thread_start_us":14492,"threads_started":1}
I20260806 10:41:22.283717 23651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.260400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:44065 (local address 127.0.0.1:56478)
0806 10:41:22.274245 (+ 13845us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.274302 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:22.275126 (+ 824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:22.275950 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:22.275959 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:22.275991 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:22.276496 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:22.276514 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.278264 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.278270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:22.280741 (+ 2471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:22.280757 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.282860 (+ 2103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.282869 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:22.283022 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.283052 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 10:41:22.283129 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 10:41:22.283249 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13511,"mutex_wait_us":23,"thread_start_us":13340,"threads_started":1}
I20260806 10:41:22.284441 23654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.260511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56478 (local address 127.16.45.66:44065)
0806 10:41:22.273263 (+ 12752us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:22.273276 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:22.274485 (+ 1209us) server_negotiation.cc:407] Connection header received
0806 10:41:22.275375 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:22.275384 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:22.275652 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:22.275869 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:22.276723 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.278132 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.280905 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.282387 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.282516 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.282696 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:22.283947 (+ 1251us) server_negotiation.cc:299] Negotiation successful
0806 10:41:22.284116 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12500,"thread_start_us":12781,"threads_started":1}
I20260806 10:41:22.286420 23659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.276657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51394 (local address 127.16.45.65:40709)
0806 10:41:22.277735 (+ 1078us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:22.277741 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:22.277768 (+ 27us) server_negotiation.cc:407] Connection header received
0806 10:41:22.277869 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:22.277876 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:22.278128 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:22.278380 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:22.279008 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.280634 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.283996 (+ 3362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.285412 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.285551 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.285774 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:22.285935 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 10:41:22.286086 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":934,"thread_start_us":772,"threads_started":1}
I20260806 10:41:22.286442 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.276324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:40709 (local address 127.0.0.1:51394)
0806 10:41:22.276958 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.276977 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:22.277084 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:22.278353 (+ 1269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:22.278357 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:22.278383 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:22.278827 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:22.278840 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.280774 (+ 1934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.280780 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:22.282922 (+ 2142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:22.282935 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.285600 (+ 2665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.285607 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:22.285772 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.285803 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 10:41:22.285892 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 10:41:22.286023 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"mutex_wait_us":36,"thread_start_us":319,"threads_started":1}
I20260806 10:41:22.288324 23326 tablet_service.cc:1467] Processing CreateTablet for tablet d347e5c5ea184d7c8d3b36535207e248 (DEFAULT_TABLE table=test-table [id=99622a9bbaae4af79ea95e4b3f61ce40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:22.288324 23514 tablet_service.cc:1467] Processing CreateTablet for tablet d347e5c5ea184d7c8d3b36535207e248 (DEFAULT_TABLE table=test-table [id=99622a9bbaae4af79ea95e4b3f61ce40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:22.289824 23514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d347e5c5ea184d7c8d3b36535207e248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:22.289839 23326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d347e5c5ea184d7c8d3b36535207e248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:22.289788 23124 tablet_service.cc:1467] Processing CreateTablet for tablet d347e5c5ea184d7c8d3b36535207e248 (DEFAULT_TABLE table=test-table [id=99622a9bbaae4af79ea95e4b3f61ce40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:22.290970 23124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d347e5c5ea184d7c8d3b36535207e248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:22.303234 23660 tablet_bootstrap.cc:492] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb: Bootstrap starting.
I20260806 10:41:22.306741 23662 tablet_bootstrap.cc:492] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63: Bootstrap starting.
I20260806 10:41:22.308449 23660 tablet_bootstrap.cc:654] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:22.309896 23660 log.cc:824] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:22.310384 23662 tablet_bootstrap.cc:654] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:22.311070 23661 tablet_bootstrap.cc:492] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b: Bootstrap starting.
I20260806 10:41:22.311836 23662 log.cc:824] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:22.314761 23661 tablet_bootstrap.cc:654] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:22.314946 23660 tablet_bootstrap.cc:492] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb: No bootstrap required, opened a new log
I20260806 10:41:22.315150 23662 tablet_bootstrap.cc:492] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63: No bootstrap required, opened a new log
I20260806 10:41:22.315452 23662 ts_tablet_manager.cc:1397] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260806 10:41:22.315708 23660 ts_tablet_manager.cc:1397] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260806 10:41:22.315999 23661 log.cc:824] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:22.319024 23661 tablet_bootstrap.cc:492] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b: No bootstrap required, opened a new log
I20260806 10:41:22.319296 23661 ts_tablet_manager.cc:1397] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 10:41:22.323071 23660 raft_consensus.cc:348] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde04170fc1f4c199a963f0c3340100b" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44065 } } peers { permanent_uuid: "6b906ebfde5b45f4b15218a824c32b63" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45583 } } peers { permanent_uuid: "7c81993cbcd0439fbae535ee17c1e5fb" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 40709 } }
I20260806 10:41:22.323419 23660 raft_consensus.cc:374] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:22.323547 23660 raft_consensus.cc:729] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c81993cbcd0439fbae535ee17c1e5fb, State: Initialized, Role: FOLLOWER
I20260806 10:41:22.324108 23660 consensus_queue.cc:260] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde04170fc1f4c199a963f0c3340100b" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44065 } } peers { permanent_uuid: "6b906ebfde5b45f4b15218a824c32b63" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45583 } } peers { permanent_uuid: "7c81993cbcd0439fbae535ee17c1e5fb" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 40709 } }
I20260806 10:41:22.325508 23662 raft_consensus.cc:348] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde04170fc1f4c199a963f0c3340100b" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44065 } } peers { permanent_uuid: "6b906ebfde5b45f4b15218a824c32b63" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45583 } } peers { permanent_uuid: "7c81993cbcd0439fbae535ee17c1e5fb" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 40709 } }
I20260806 10:41:22.325789 23660 ts_tablet_manager.cc:1428] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260806 10:41:22.325963 23662 raft_consensus.cc:374] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:22.326083 23662 raft_consensus.cc:729] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b906ebfde5b45f4b15218a824c32b63, State: Initialized, Role: FOLLOWER
I20260806 10:41:22.326705 23662 consensus_queue.cc:260] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde04170fc1f4c199a963f0c3340100b" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44065 } } peers { permanent_uuid: "6b906ebfde5b45f4b15218a824c32b63" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45583 } } peers { permanent_uuid: "7c81993cbcd0439fbae535ee17c1e5fb" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 40709 } }
I20260806 10:41:22.329388 23661 raft_consensus.cc:348] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde04170fc1f4c199a963f0c3340100b" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44065 } } peers { permanent_uuid: "6b906ebfde5b45f4b15218a824c32b63" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45583 } } peers { permanent_uuid: "7c81993cbcd0439fbae535ee17c1e5fb" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 40709 } }
I20260806 10:41:22.329808 23661 raft_consensus.cc:374] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:22.329902 23661 raft_consensus.cc:729] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fde04170fc1f4c199a963f0c3340100b, State: Initialized, Role: FOLLOWER
I20260806 10:41:22.330528 23661 consensus_queue.cc:260] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde04170fc1f4c199a963f0c3340100b" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44065 } } peers { permanent_uuid: "6b906ebfde5b45f4b15218a824c32b63" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45583 } } peers { permanent_uuid: "7c81993cbcd0439fbae535ee17c1e5fb" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 40709 } }
I20260806 10:41:22.331066 23629 heartbeater.cc:503] Master 127.16.45.126:34499 was elected leader, sending a full tablet report...
I20260806 10:41:22.331684 23417 heartbeater.cc:503] Master 127.16.45.126:34499 was elected leader, sending a full tablet report...
I20260806 10:41:22.332156 23661 ts_tablet_manager.cc:1428] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260806 10:41:22.333150 23662 ts_tablet_manager.cc:1428] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63: Time spent starting tablet: real 0.018s user 0.016s sys 0.000s
I20260806 10:41:22.353893 23670 raft_consensus.cc:482] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:22.354288 23670 raft_consensus.cc:504] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde04170fc1f4c199a963f0c3340100b" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44065 } } peers { permanent_uuid: "6b906ebfde5b45f4b15218a824c32b63" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45583 } } peers { permanent_uuid: "7c81993cbcd0439fbae535ee17c1e5fb" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 40709 } }
I20260806 10:41:22.356338 23670 leader_election.cc:288] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b906ebfde5b45f4b15218a824c32b63 (127.16.45.67:45583), 7c81993cbcd0439fbae535ee17c1e5fb (127.16.45.65:40709)
I20260806 10:41:22.364431 23656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.356662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:44869 (local address 127.16.45.67:45583)
0806 10:41:22.356908 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:22.356914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:22.357302 (+ 388us) server_negotiation.cc:407] Connection header received
0806 10:41:22.357553 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:22.357558 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:22.357640 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:22.357705 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:22.358501 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.359536 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.361980 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.363290 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.363463 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.363537 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:22.364036 (+ 499us) server_negotiation.cc:299] Negotiation successful
0806 10:41:22.364175 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 10:41:22.364434 23659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.357547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:56241 (local address 127.16.45.65:40709)
0806 10:41:22.357751 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:22.357757 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:22.357863 (+ 106us) server_negotiation.cc:407] Connection header received
0806 10:41:22.358022 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:22.358026 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:22.358111 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:22.358212 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:22.358842 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.359848 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.362139 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.363325 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.363463 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.363536 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:22.364036 (+ 500us) server_negotiation.cc:299] Negotiation successful
0806 10:41:22.364175 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 10:41:22.364605 23671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.356557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:45583 (local address 127.16.45.66:44869)
0806 10:41:22.357174 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.357194 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:22.357358 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:22.357933 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:22.357937 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:22.357967 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:22.358356 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:22.358370 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.359649 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.359652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:22.361799 (+ 2147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:22.361815 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.363576 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.363581 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:22.363814 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.363860 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 10:41:22.363957 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 10:41:22.364133 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"mutex_wait_us":61,"thread_start_us":321,"threads_started":1}
I20260806 10:41:22.364729 23672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.357224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:40709 (local address 127.16.45.66:56241)
0806 10:41:22.357777 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.357791 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:22.357896 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:22.358257 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:22.358261 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:22.358290 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:22.358672 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:22.358681 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.359980 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.359985 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:22.361985 (+ 2000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:22.361996 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.363551 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.363561 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:22.363833 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.363879 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 10:41:22.363957 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 10:41:22.364133 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"mutex_wait_us":108,"thread_start_us":289,"threads_started":1}
I20260806 10:41:22.365671 23155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d347e5c5ea184d7c8d3b36535207e248" candidate_uuid: "fde04170fc1f4c199a963f0c3340100b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c81993cbcd0439fbae535ee17c1e5fb" is_pre_election: true
I20260806 10:41:22.365876 23550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d347e5c5ea184d7c8d3b36535207e248" candidate_uuid: "fde04170fc1f4c199a963f0c3340100b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b906ebfde5b45f4b15218a824c32b63" is_pre_election: true
I20260806 10:41:22.366170 23155 raft_consensus.cc:2454] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fde04170fc1f4c199a963f0c3340100b in term 0.
I20260806 10:41:22.366384 23550 raft_consensus.cc:2454] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fde04170fc1f4c199a963f0c3340100b in term 0.
I20260806 10:41:22.366847 23256 leader_election.cc:302] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c81993cbcd0439fbae535ee17c1e5fb, fde04170fc1f4c199a963f0c3340100b; no voters:
I20260806 10:41:22.367205 23670 raft_consensus.cc:2781] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:22.367353 23670 raft_consensus.cc:482] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:22.367452 23670 raft_consensus.cc:3037] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:22.369830 23670 raft_consensus.cc:504] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde04170fc1f4c199a963f0c3340100b" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44065 } } peers { permanent_uuid: "6b906ebfde5b45f4b15218a824c32b63" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45583 } } peers { permanent_uuid: "7c81993cbcd0439fbae535ee17c1e5fb" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 40709 } }
I20260806 10:41:22.370488 23670 leader_election.cc:288] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [CANDIDATE]: Term 1 election: Requested vote from peers 6b906ebfde5b45f4b15218a824c32b63 (127.16.45.67:45583), 7c81993cbcd0439fbae535ee17c1e5fb (127.16.45.65:40709)
I20260806 10:41:22.370931 23550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d347e5c5ea184d7c8d3b36535207e248" candidate_uuid: "fde04170fc1f4c199a963f0c3340100b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b906ebfde5b45f4b15218a824c32b63"
I20260806 10:41:22.371006 23155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d347e5c5ea184d7c8d3b36535207e248" candidate_uuid: "fde04170fc1f4c199a963f0c3340100b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c81993cbcd0439fbae535ee17c1e5fb"
I20260806 10:41:22.371111 23550 raft_consensus.cc:3037] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:22.371219 23155 raft_consensus.cc:3037] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:22.373344 23550 raft_consensus.cc:2454] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fde04170fc1f4c199a963f0c3340100b in term 1.
I20260806 10:41:22.373414 23155 raft_consensus.cc:2454] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fde04170fc1f4c199a963f0c3340100b in term 1.
I20260806 10:41:22.373751 23256 leader_election.cc:302] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b906ebfde5b45f4b15218a824c32b63, fde04170fc1f4c199a963f0c3340100b; no voters:
I20260806 10:41:22.374027 23670 raft_consensus.cc:2781] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:22.374539 23670 raft_consensus.cc:686] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 1 LEADER]: Becoming Leader. State: Replica: fde04170fc1f4c199a963f0c3340100b, State: Running, Role: LEADER
I20260806 10:41:22.375090 23670 consensus_queue.cc:237] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde04170fc1f4c199a963f0c3340100b" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44065 } } peers { permanent_uuid: "6b906ebfde5b45f4b15218a824c32b63" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45583 } } peers { permanent_uuid: "7c81993cbcd0439fbae535ee17c1e5fb" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 40709 } }
I20260806 10:41:22.380136 22939 catalog_manager.cc:5495] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b reported cstate change: term changed from 0 to 1, leader changed from <none> to fde04170fc1f4c199a963f0c3340100b (127.16.45.66). New cstate: current_term: 1 leader_uuid: "fde04170fc1f4c199a963f0c3340100b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fde04170fc1f4c199a963f0c3340100b" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b906ebfde5b45f4b15218a824c32b63" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c81993cbcd0439fbae535ee17c1e5fb" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 40709 } health_report { overall_health: UNKNOWN } } }
W20260806 10:41:22.405349 23418 tablet.cc:2369] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:41:22.407435 23223 tablet.cc:2369] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:41:22.412823 23654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.407435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56488 (local address 127.16.45.66:44065)
0806 10:41:22.407651 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:22.407657 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:22.407754 (+ 97us) server_negotiation.cc:407] Connection header received
0806 10:41:22.407993 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:22.407997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:22.408075 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:22.408203 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:22.408577 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.409345 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.410743 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.411152 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.411260 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.411734 (+ 474us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:22.412224 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:22.412389 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:22.412442 (+ 53us) server_negotiation.cc:299] Negotiation successful
0806 10:41:22.412526 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 10:41:22.421110 23155 raft_consensus.cc:1261] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb [term 1 FOLLOWER]: Refusing update from remote peer fde04170fc1f4c199a963f0c3340100b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:22.421145 23550 raft_consensus.cc:1261] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63 [term 1 FOLLOWER]: Refusing update from remote peer fde04170fc1f4c199a963f0c3340100b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:22.422082 23670 consensus_queue.cc:1035] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b906ebfde5b45f4b15218a824c32b63" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:22.422421 23674 consensus_queue.cc:1035] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c81993cbcd0439fbae535ee17c1e5fb" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 40709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:22.433858 23678 mvcc.cc:205] Tried to move back new op lower bound from 7315508766386700288 to 7315508766212612096. Current Snapshot: MvccSnapshot[applied={T|T < 7315508766386700288}]
I20260806 10:41:22.435839 23679 mvcc.cc:205] Tried to move back new op lower bound from 7315508766386700288 to 7315508766212612096. Current Snapshot: MvccSnapshot[applied={T|T < 7315508766386700288}]
I20260806 10:41:22.448374 22938 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53138:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:22.448638 22938 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53138:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:22.452706 22938 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0b927ab27005406796d9a8fa3b0c2262: Sending DeleteTablet for 3 replicas of tablet d347e5c5ea184d7c8d3b36535207e248
I20260806 10:41:22.453940 23326 tablet_service.cc:1514] Processing DeleteTablet for tablet d347e5c5ea184d7c8d3b36535207e248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:22 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:56478
I20260806 10:41:22.454036 23124 tablet_service.cc:1514] Processing DeleteTablet for tablet d347e5c5ea184d7c8d3b36535207e248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:22 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:51394
I20260806 10:41:22.454308 23514 tablet_service.cc:1514] Processing DeleteTablet for tablet d347e5c5ea184d7c8d3b36535207e248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:22 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:58864
I20260806 10:41:22.456209 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 23027
I20260806 10:41:22.466341 23694 tablet_replica.cc:330] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b: stopping tablet replica
I20260806 10:41:22.466938 23699 tablet_replica.cc:330] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63: stopping tablet replica
I20260806 10:41:22.467610 23699 raft_consensus.cc:2229] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:22.468148 23694 raft_consensus.cc:2229] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:41:22.468961 23694 raft_consensus.cc:2258] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:22.469651 23699 raft_consensus.cc:2258] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:22.472621 23699 ts_tablet_manager.cc:1905] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:22.474437 23694 ts_tablet_manager.cc:1905] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:22.474984 23696 tablet_replica.cc:330] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb: stopping tablet replica
I20260806 10:41:22.479029 23696 raft_consensus.cc:2229] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:22.481849 23699 ts_tablet_manager.cc:1918] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:22.482079 23699 log.cc:1196] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/d347e5c5ea184d7c8d3b36535207e248
Aug 06 10:41:22 dist-test-slave-fgb3 krb5kdc[22876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:41:22.482228 23694 ts_tablet_manager.cc:1918] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:22.482517 23694 log.cc:1196] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/d347e5c5ea184d7c8d3b36535207e248
I20260806 10:41:22.482664 23696 raft_consensus.cc:2258] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:22.482756 23699 ts_tablet_manager.cc:1939] T d347e5c5ea184d7c8d3b36535207e248 P 6b906ebfde5b45f4b15218a824c32b63: Deleting consensus metadata
I20260806 10:41:22.483214 23694 ts_tablet_manager.cc:1939] T d347e5c5ea184d7c8d3b36535207e248 P fde04170fc1f4c199a963f0c3340100b: Deleting consensus metadata
I20260806 10:41:22.484956 22918 catalog_manager.cc:4841] TS fde04170fc1f4c199a963f0c3340100b (127.16.45.66:44065): tablet d347e5c5ea184d7c8d3b36535207e248 (table test-table [id=99622a9bbaae4af79ea95e4b3f61ce40]) successfully deleted
I20260806 10:41:22.484934 22917 catalog_manager.cc:4841] TS 6b906ebfde5b45f4b15218a824c32b63 (127.16.45.67:45583): tablet d347e5c5ea184d7c8d3b36535207e248 (table test-table [id=99622a9bbaae4af79ea95e4b3f61ce40]) successfully deleted
I20260806 10:41:22.486291 23696 ts_tablet_manager.cc:1905] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:22.492247 23696 ts_tablet_manager.cc:1918] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:22.492394 23659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.457625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51404 (local address 127.16.45.65:40709)
0806 10:41:22.457805 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:22.457824 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:22.471396 (+ 13572us) server_negotiation.cc:407] Connection header received
0806 10:41:22.471896 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:22.471902 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:22.471989 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:22.472085 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:22.473831 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.475011 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.477137 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.477762 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.477869 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.484788 (+ 6919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:22.484803 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:22.484819 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:22.484870 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:22.488902 (+ 4032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:22.489709 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:22.489719 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:22.489723 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:22.489934 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:22.490501 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:22.490507 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:22.490510 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:22.491031 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:22.491373 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:22.491656 (+ 283us) server_negotiation.cc:299] Negotiation successful
0806 10:41:22.491957 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 10:41:22.492484 23696 log.cc:1196] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/d347e5c5ea184d7c8d3b36535207e248
I20260806 10:41:22.493139 23216 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:22.591032 23696 ts_tablet_manager.cc:1939] T d347e5c5ea184d7c8d3b36535207e248 P 7c81993cbcd0439fbae535ee17c1e5fb: Deleting consensus metadata
I20260806 10:41:22.591781 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 23027
I20260806 10:41:22.612879 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 23228
W20260806 10:41:22.613024 22917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.45.65:40709 (error 108)
I20260806 10:41:22.616802 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.616306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:40709 (local address 127.0.0.1:51408)
0806 10:41:22.616503 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.616625 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:40709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260806 10:41:22.617183 22917 catalog_manager.cc:4584] TS 7c81993cbcd0439fbae535ee17c1e5fb (127.16.45.65:40709): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d347e5c5ea184d7c8d3b36535207e248: Network error: Client connection negotiation failed: client connection to 127.16.45.65:40709: connect: Connection refused (error 111)
Aug 06 10:41:22 dist-test-slave-fgb3 krb5kdc[22876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:41:22.629698 23654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.613939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56492 (local address 127.16.45.66:44065)
0806 10:41:22.614142 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:22.614148 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:22.614167 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:41:22.614231 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:22.614236 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:22.614370 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:22.614481 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:22.616114 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.617171 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.618640 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.619106 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.619223 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.623629 (+ 4406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:22.623646 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:22.623661 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:22.623715 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:22.626901 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:22.627571 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:22.627579 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:22.627581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:22.627726 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:22.628098 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:22.628102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:22.628104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:22.628467 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:22.628788 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:22.629056 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 10:41:22.629315 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 10:41:22.630343 23411 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:22.671118 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.670617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:40709 (local address 127.0.0.1:51412)
0806 10:41:22.670846 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.670946 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:40709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260806 10:41:22.672181 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.671844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:40709 (local address 127.0.0.1:51422)
0806 10:41:22.671976 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.672064 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:40709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260806 10:41:22.732878 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.732329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:40709 (local address 127.0.0.1:51428)
0806 10:41:22.732590 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.732688 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:40709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260806 10:41:22.734014 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.733630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:40709 (local address 127.0.0.1:51438)
0806 10:41:22.733805 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.733891 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:40709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 10:41:22.745337 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 23228
I20260806 10:41:22.771198 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 23428
Aug 06 10:41:22 dist-test-slave-fgb3 krb5kdc[22876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:41:22.786044 23656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.771977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58876 (local address 127.16.45.67:45583)
0806 10:41:22.772136 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:22.772140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:22.772160 (+ 20us) server_negotiation.cc:407] Connection header received
0806 10:41:22.772296 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:22.772300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:22.772378 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:22.772462 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:22.773770 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.774616 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.775917 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:22.776293 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:22.776381 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:22.780687 (+ 4306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:22.780703 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:22.780719 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:22.780754 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:22.783446 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:22.784117 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:22.784127 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:22.784130 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:22.784300 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:22.784691 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:22.784694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:22.784696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:22.785071 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:22.785290 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:22.785564 (+ 274us) server_negotiation.cc:299] Negotiation successful
0806 10:41:22.785737 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 10:41:22.786791 23622 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:22.815142 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.814684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:40709 (local address 127.0.0.1:51446)
0806 10:41:22.814887 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.814979 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:40709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 10:41:22.816227 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:22.815819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:40709 (local address 127.0.0.1:51448)
0806 10:41:22.816040 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:22.816111 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:40709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260806 10:41:22.874173 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 23428
I20260806 10:41:22.895489 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 22891
I20260806 10:41:22.896620 22987 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:23.004179 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:23.003579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:40709 (local address 127.0.0.1:51462)
0806 10:41:23.003863 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:23.003988 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:40709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260806 10:41:23.004271 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 22891
2026-08-06T10:41:23Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4260 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T10:41:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:23Z Disabled control of system clock
I20260806 10:41:23.077426 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:33019
--webserver_interface=127.16.45.126
--webserver_port=0
--builtin_ntp_servers=127.16.45.84:42075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:33019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 10:41:23.400350 23714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:23.400652 23714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:23.400738 23714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:23.407920 23714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:23.408036 23714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:23.408073 23714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:23.408126 23714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:23.408169 23714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:23.417402 23714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:33019
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:33019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:23.418759 23714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:23.420531 23714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:23.432734 23720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:23.432938 23719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:23.433111 23722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:23.433904 23714 server_base.cc:1034] running on GCE node
I20260806 10:41:23.434831 23714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:23.436348 23714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:23.437608 23714 hybrid_clock.cc:648] HybridClock initialized: now 1786012883437544 us; error 43 us; skew 500 ppm
I20260806 10:41:23.438061 23714 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:41:23.440609 23714 webserver.cc:460] Webserver started at http://127.16.45.126:33155/ using document root <none> and password file <none>
I20260806 10:41:23.441334 23714 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:23.441444 23714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:23.441769 23714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:23.444849 23714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "7ad65706c1e24e869ebeab6ec6317c6e"
format_stamp: "Formatted at 2026-08-06 10:41:23 on dist-test-slave-fgb3"
server_key: "611934827d8dd48bdf1c4c749e40f830"
server_key_iv: "24f81f45dc86c80e412a99baeddb8cea"
server_key_version: "encryptionkey@0"
I20260806 10:41:23.445746 23714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "7ad65706c1e24e869ebeab6ec6317c6e"
format_stamp: "Formatted at 2026-08-06 10:41:23 on dist-test-slave-fgb3"
server_key: "611934827d8dd48bdf1c4c749e40f830"
server_key_iv: "24f81f45dc86c80e412a99baeddb8cea"
server_key_version: "encryptionkey@0"
I20260806 10:41:23.451239 23714 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260806 10:41:23.454949 23732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:23.456416 23714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 10:41:23.456589 23714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "7ad65706c1e24e869ebeab6ec6317c6e"
format_stamp: "Formatted at 2026-08-06 10:41:23 on dist-test-slave-fgb3"
server_key: "611934827d8dd48bdf1c4c749e40f830"
server_key_iv: "24f81f45dc86c80e412a99baeddb8cea"
server_key_version: "encryptionkey@0"
I20260806 10:41:23.456797 23714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:23.462586 23714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:23.463330 23714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:23.463613 23714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:23.481104 23714 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:33019
I20260806 10:41:23.481133 23813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:33019 every 8 connection(s)
I20260806 10:41:23.482522 23714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:23.486506 23815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:23.486739 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 23714
I20260806 10:41:23.486941 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:23.487771 16565 external_mini_cluster.cc:1428] Setting key 4b331ea857a7fea1f536665eb46ad21a
I20260806 10:41:23.496068 23823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:23.489656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54350 (local address 127.16.45.126:33019)
0806 10:41:23.490633 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:23.490644 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:23.490688 (+ 44us) server_negotiation.cc:407] Connection header received
0806 10:41:23.492509 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:23.492533 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:23.492961 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:23.493339 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:23.494437 (+ 1098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:23.494443 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:23.494458 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:23.494476 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:23.494536 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:23.494551 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:23.494766 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:23.494928 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 10:41:23.495181 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":310,"threads_started":1}
I20260806 10:41:23.501675 23815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e: Bootstrap starting.
I20260806 10:41:23.505134 23815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:23.506157 23815 log.cc:824] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:23.509023 23815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e: No bootstrap required, opened a new log
I20260806 10:41:23.516227 23815 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad65706c1e24e869ebeab6ec6317c6e" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33019 } }
I20260806 10:41:23.516628 23815 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:23.516731 23815 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad65706c1e24e869ebeab6ec6317c6e, State: Initialized, Role: FOLLOWER
I20260806 10:41:23.517336 23815 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad65706c1e24e869ebeab6ec6317c6e" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33019 } }
I20260806 10:41:23.517572 23815 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:23.517705 23815 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:23.517858 23815 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:23.520140 23815 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad65706c1e24e869ebeab6ec6317c6e" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33019 } }
I20260806 10:41:23.520680 23815 leader_election.cc:302] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ad65706c1e24e869ebeab6ec6317c6e; no voters:
I20260806 10:41:23.521401 23815 leader_election.cc:288] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:23.521529 23825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:23.522547 23825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [term 1 LEADER]: Becoming Leader. State: Replica: 7ad65706c1e24e869ebeab6ec6317c6e, State: Running, Role: LEADER
I20260806 10:41:23.523187 23825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad65706c1e24e869ebeab6ec6317c6e" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33019 } }
I20260806 10:41:23.523914 23815 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:23.526469 23826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ad65706c1e24e869ebeab6ec6317c6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad65706c1e24e869ebeab6ec6317c6e" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33019 } } }
I20260806 10:41:23.526501 23827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ad65706c1e24e869ebeab6ec6317c6e. Latest consensus state: current_term: 1 leader_uuid: "7ad65706c1e24e869ebeab6ec6317c6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad65706c1e24e869ebeab6ec6317c6e" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33019 } } }
I20260806 10:41:23.526957 23827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:23.526933 23826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:23.529166 23837 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:23.533463 23837 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:23.541613 23837 catalog_manager.cc:1347] Generated new cluster ID: 261282518d784590b682a70bb40f6da3
I20260806 10:41:23.541743 23837 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:23.558667 23837 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:23.559207 23837 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:23.571421 23837 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e: Generated new TSK 0
I20260806 10:41:23.572592 23837 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:41:23.582871 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33019
--builtin_ntp_servers=127.16.45.84:42075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 10:41:23.913241 23853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:23.913604 23853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:23.913749 23853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:23.921232 23853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:23.921360 23853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:23.921516 23853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:41:23.930915 23853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33019
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:23.932245 23853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:23.934013 23853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:23.947309 23863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:23.947378 23862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:23.947706 23865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:23.948082 23853 server_base.cc:1034] running on GCE node
I20260806 10:41:23.948671 23853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:23.949666 23853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:23.950906 23853 hybrid_clock.cc:648] HybridClock initialized: now 1786012883950842 us; error 51 us; skew 500 ppm
I20260806 10:41:23.951218 23853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:41:23.953445 23853 webserver.cc:460] Webserver started at http://127.16.45.65:38051/ using document root <none> and password file <none>
I20260806 10:41:23.954173 23853 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:23.954304 23853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:23.954653 23853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:23.957436 23853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "18126a6b061c4957957db885ded25db7"
format_stamp: "Formatted at 2026-08-06 10:41:23 on dist-test-slave-fgb3"
server_key: "1387bc1f042d0b582363c9de4618f810"
server_key_iv: "a399d41c290e5a5434848e087487e684"
server_key_version: "encryptionkey@0"
I20260806 10:41:23.958192 23853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "18126a6b061c4957957db885ded25db7"
format_stamp: "Formatted at 2026-08-06 10:41:23 on dist-test-slave-fgb3"
server_key: "1387bc1f042d0b582363c9de4618f810"
server_key_iv: "a399d41c290e5a5434848e087487e684"
server_key_version: "encryptionkey@0"
I20260806 10:41:23.963294 23853 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260806 10:41:23.966635 23875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:23.968075 23853 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 10:41:23.968245 23853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "18126a6b061c4957957db885ded25db7"
format_stamp: "Formatted at 2026-08-06 10:41:23 on dist-test-slave-fgb3"
server_key: "1387bc1f042d0b582363c9de4618f810"
server_key_iv: "a399d41c290e5a5434848e087487e684"
server_key_version: "encryptionkey@0"
I20260806 10:41:23.968468 23853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:23.973820 23853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:23.974694 23853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:23.974956 23853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:23.975865 23853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:23.977264 23853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:23.977360 23853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:23.977465 23853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:23.977542 23853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:24.006966 23853 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:35755
I20260806 10:41:24.007025 24062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:35755 every 8 connection(s)
I20260806 10:41:24.008284 23853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:41:24.016422 24066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.010952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:55819 (local address 127.16.45.126:33019)
0806 10:41:24.011402 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:24.011407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:24.012543 (+ 1136us) server_negotiation.cc:407] Connection header received
0806 10:41:24.014207 (+ 1664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:24.014213 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:24.014278 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:24.014400 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:24.015664 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:24.015668 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:24.015671 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:24.015688 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:24.015735 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:24.015748 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:24.015856 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:24.016002 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 10:41:24.016056 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":218,"threads_started":1}
I20260806 10:41:24.016644 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 23853
I20260806 10:41:24.016844 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:41:24.017262 24068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.011435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33019 (local address 127.16.45.65:55819)
0806 10:41:24.012376 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:24.012413 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:24.013938 (+ 1525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:24.014606 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:24.014615 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:24.014706 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:24.015310 (+ 604us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:41:24.015312 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:24.015350 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:41:24.015473 (+ 123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:24.015835 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:24.015841 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:24.015846 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 10:41:24.016065 (+ 219us) client_negotiation.cc:240] Negotiation successful
0806 10:41:24.016266 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":263,"threads_started":1}
I20260806 10:41:24.017527 16565 external_mini_cluster.cc:1428] Setting key 39ad96352e0721720949e3f46c32d23a
I20260806 10:41:24.018740 24063 heartbeater.cc:347] Connected to a master server at 127.16.45.126:33019
I20260806 10:41:24.019070 24063 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:24.019724 24063 heartbeater.cc:511] Master 127.16.45.126:33019 requested a full tablet report, sending...
I20260806 10:41:24.020601 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33019
--builtin_ntp_servers=127.16.45.84:42075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 10:41:24.022234 23756 ts_manager.cc:194] Registered new tserver with Master: 18126a6b061c4957957db885ded25db7 (127.16.45.65:35755)
W20260806 10:41:24.345430 24069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:24.345716 24069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:24.345853 24069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:24.352993 24069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:24.353120 24069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:24.353276 24069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:41:24.362351 24069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33019
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:24.363615 24069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:24.365367 24069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:24.378091 24079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:24.378185 24080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:24.378186 24083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:24.379221 24069 server_base.cc:1034] running on GCE node
I20260806 10:41:24.379786 24069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:24.380713 24069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:24.381915 24069 hybrid_clock.cc:648] HybridClock initialized: now 1786012884381864 us; error 41 us; skew 500 ppm
I20260806 10:41:24.382225 24069 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:41:24.384593 24069 webserver.cc:460] Webserver started at http://127.16.45.66:41879/ using document root <none> and password file <none>
I20260806 10:41:24.385288 24069 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:24.385393 24069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:24.385718 24069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:24.388667 24069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "2d53832f691c40389a6352cdf476f8e6"
format_stamp: "Formatted at 2026-08-06 10:41:24 on dist-test-slave-fgb3"
server_key: "73022bf164814a077b839efc5f3fbcc5"
server_key_iv: "e17250d58cda2fd732c4aaea8973a0f9"
server_key_version: "encryptionkey@0"
I20260806 10:41:24.389515 24069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "2d53832f691c40389a6352cdf476f8e6"
format_stamp: "Formatted at 2026-08-06 10:41:24 on dist-test-slave-fgb3"
server_key: "73022bf164814a077b839efc5f3fbcc5"
server_key_iv: "e17250d58cda2fd732c4aaea8973a0f9"
server_key_version: "encryptionkey@0"
I20260806 10:41:24.394641 24069 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:41:24.397995 24090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:24.399305 24069 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:24.399480 24069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "2d53832f691c40389a6352cdf476f8e6"
format_stamp: "Formatted at 2026-08-06 10:41:24 on dist-test-slave-fgb3"
server_key: "73022bf164814a077b839efc5f3fbcc5"
server_key_iv: "e17250d58cda2fd732c4aaea8973a0f9"
server_key_version: "encryptionkey@0"
I20260806 10:41:24.399685 24069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:24.405404 24069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:24.406180 24069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:24.406492 24069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:24.407397 24069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:24.408790 24069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:24.408883 24069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:24.408987 24069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:24.409053 24069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:24.439595 24069 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:44139
I20260806 10:41:24.439648 24273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:44139 every 8 connection(s)
I20260806 10:41:24.440894 24069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:41:24.443169 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 24069
I20260806 10:41:24.443328 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:41:24.443856 16565 external_mini_cluster.cc:1428] Setting key 592801db4eab602d51a9b4d6751596ef
I20260806 10:41:24.446503 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33019
--builtin_ntp_servers=127.16.45.84:42075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 10:41:24.449204 24066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.443487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:35975 (local address 127.16.45.126:33019)
0806 10:41:24.443710 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:24.443716 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:24.445272 (+ 1556us) server_negotiation.cc:407] Connection header received
0806 10:41:24.447052 (+ 1780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:24.447057 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:24.447136 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:24.447226 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:24.448502 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:24.448508 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:24.448512 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:24.448528 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:24.448562 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:24.448573 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:24.448674 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:24.448859 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 10:41:24.448930 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 10:41:24.450110 24279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.444082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33019 (local address 127.16.45.66:35975)
0806 10:41:24.445122 (+ 1040us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:24.445166 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:24.446789 (+ 1623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:24.447471 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:24.447479 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:24.447569 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:24.448198 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:41:24.448200 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:24.448240 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:41:24.448328 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:24.448660 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:24.448671 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:24.448678 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 10:41:24.448944 (+ 266us) client_negotiation.cc:240] Negotiation successful
0806 10:41:24.449198 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":319,"threads_started":1}
I20260806 10:41:24.451735 24274 heartbeater.cc:347] Connected to a master server at 127.16.45.126:33019
I20260806 10:41:24.452082 24274 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:24.452703 24274 heartbeater.cc:511] Master 127.16.45.126:33019 requested a full tablet report, sending...
I20260806 10:41:24.454211 23756 ts_manager.cc:194] Registered new tserver with Master: 2d53832f691c40389a6352cdf476f8e6 (127.16.45.66:44139)
W20260806 10:41:24.770753 24280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:24.771046 24280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:24.771188 24280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:24.778527 24280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:24.778641 24280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:24.778800 24280 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:41:24.788046 24280 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33019
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:24.789359 24280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:24.791203 24280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:24.805305 24290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:24.805429 24287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:24.805624 24286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:24.806705 24280 server_base.cc:1034] running on GCE node
I20260806 10:41:24.807539 24280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:24.808791 24280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:24.810034 24280 hybrid_clock.cc:648] HybridClock initialized: now 1786012884809939 us; error 79 us; skew 500 ppm
I20260806 10:41:24.810467 24280 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:41:24.813344 24280 webserver.cc:460] Webserver started at http://127.16.45.67:43189/ using document root <none> and password file <none>
I20260806 10:41:24.814232 24280 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:24.814388 24280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:24.814769 24280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:24.818876 24280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "6ae8f489118c4880a20e762fc6564baf"
format_stamp: "Formatted at 2026-08-06 10:41:24 on dist-test-slave-fgb3"
server_key: "14cf8bdb36c1ef5fb06c406969980f60"
server_key_iv: "2d059c1f016207144d582bb5a61a5bca"
server_key_version: "encryptionkey@0"
I20260806 10:41:24.819960 24280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "6ae8f489118c4880a20e762fc6564baf"
format_stamp: "Formatted at 2026-08-06 10:41:24 on dist-test-slave-fgb3"
server_key: "14cf8bdb36c1ef5fb06c406969980f60"
server_key_iv: "2d059c1f016207144d582bb5a61a5bca"
server_key_version: "encryptionkey@0"
I20260806 10:41:24.826956 24280 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260806 10:41:24.831344 24300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:24.832809 24280 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:41:24.832959 24280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "6ae8f489118c4880a20e762fc6564baf"
format_stamp: "Formatted at 2026-08-06 10:41:24 on dist-test-slave-fgb3"
server_key: "14cf8bdb36c1ef5fb06c406969980f60"
server_key_iv: "2d059c1f016207144d582bb5a61a5bca"
server_key_version: "encryptionkey@0"
I20260806 10:41:24.833174 24280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:24.838858 24280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:24.839669 24280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:24.839915 24280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:24.840863 24280 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:24.842283 24280 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:24.842413 24280 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 10:41:24.842509 24280 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:24.842589 24280 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:24.882179 24280 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:39389
I20260806 10:41:24.882261 24467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:39389 every 8 connection(s)
I20260806 10:41:24.883589 24280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:41:24.892961 24066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.886422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:57371 (local address 127.16.45.126:33019)
0806 10:41:24.886629 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:24.886635 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:24.888203 (+ 1568us) server_negotiation.cc:407] Connection header received
0806 10:41:24.890609 (+ 2406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:24.890614 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:24.890674 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:24.890764 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:24.892299 (+ 1535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:24.892304 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:24.892308 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:24.892326 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:24.892361 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:24.892373 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:24.892481 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:24.892664 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 10:41:24.892718 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:41:24.893905 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 24280
I20260806 10:41:24.894065 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:41:24.894268 24473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.886948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33019 (local address 127.16.45.67:57371)
0806 10:41:24.888025 (+ 1077us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:24.888073 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:24.890261 (+ 2188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:24.891037 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:24.891049 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:24.891176 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:24.891925 (+ 749us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:41:24.891928 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:24.891979 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:41:24.892092 (+ 113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:24.892461 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:24.892471 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:24.892478 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 10:41:24.892739 (+ 261us) client_negotiation.cc:240] Negotiation successful
0806 10:41:24.893005 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":307,"threads_started":1}
I20260806 10:41:24.894613 16565 external_mini_cluster.cc:1428] Setting key 3ee5a1f11cebc5759a466a4343b2254a
I20260806 10:41:24.895865 24468 heartbeater.cc:347] Connected to a master server at 127.16.45.126:33019
I20260806 10:41:24.896178 24468 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:24.896874 24468 heartbeater.cc:511] Master 127.16.45.126:33019 requested a full tablet report, sending...
I20260806 10:41:24.898434 23756 ts_manager.cc:194] Registered new tserver with Master: 6ae8f489118c4880a20e762fc6564baf (127.16.45.67:39389)
I20260806 10:41:24.909530 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:41:24.916536 24066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.914040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38100 (local address 127.16.45.126:33019)
0806 10:41:24.914230 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:24.914236 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:24.914718 (+ 482us) server_negotiation.cc:407] Connection header received
0806 10:41:24.914892 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:24.914897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:24.914976 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:24.915081 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:24.915893 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:24.915900 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:24.915904 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:24.915923 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:24.915965 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:24.915981 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:24.916115 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:24.916161 (+ 46us) server_negotiation.cc:299] Negotiation successful
0806 10:41:24.916224 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 10:41:24.920265 23756 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:41:24.927219 23756 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:24.948221 24489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.939462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43656 (local address 127.16.45.65:35755)
0806 10:41:24.940100 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:24.940110 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:24.944299 (+ 4189us) server_negotiation.cc:407] Connection header received
0806 10:41:24.944584 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:24.944592 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:24.944824 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:24.944950 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:24.947345 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:24.947353 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:24.947381 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:24.947410 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:24.947471 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:24.947493 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:24.947597 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:24.947892 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 10:41:24.947975 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":297,"threads_started":1}
I20260806 10:41:24.948374 24485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.938957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35755 (local address 127.0.0.1:43656)
0806 10:41:24.944105 (+ 5148us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:24.944188 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:24.944422 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:24.945960 (+ 1538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:24.945967 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:24.946060 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:24.947016 (+ 956us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:41:24.947019 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:24.947056 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:41:24.947148 (+ 92us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:24.947686 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:24.947698 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:24.947704 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 10:41:24.947872 (+ 168us) client_negotiation.cc:240] Negotiation successful
0806 10:41:24.947959 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4992,"spinlock_wait_cycles":15616,"thread_start_us":4702,"threads_started":1}
I20260806 10:41:24.949818 24488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.939027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33454 (local address 127.16.45.67:39389)
0806 10:41:24.943652 (+ 4625us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:24.943660 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:24.944300 (+ 640us) server_negotiation.cc:407] Connection header received
0806 10:41:24.944585 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:24.944592 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:24.944824 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:24.944950 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:24.948827 (+ 3877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:24.948835 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:24.948847 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:24.948866 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:24.948931 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:24.948953 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:24.949113 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:24.949342 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 10:41:24.949452 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4469,"thread_start_us":4298,"threads_started":1}
I20260806 10:41:24.950714 24491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.938898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:39389 (local address 127.0.0.1:33454)
0806 10:41:24.944105 (+ 5207us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:24.944188 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:24.944422 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:24.946582 (+ 2160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:24.946586 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:24.946608 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:24.948620 (+ 2012us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:41:24.948623 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:24.948639 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:41:24.948682 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:24.949172 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:24.949177 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:24.949182 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 10:41:24.950166 (+ 984us) client_negotiation.cc:240] Negotiation successful
0806 10:41:24.950216 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4913,"spinlock_wait_cycles":3200,"thread_start_us":4899,"threads_started":1}
I20260806 10:41:24.950845 24496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.944952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53006 (local address 127.16.45.66:44139)
0806 10:41:24.947923 (+ 2971us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:24.947939 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:24.947966 (+ 27us) server_negotiation.cc:407] Connection header received
0806 10:41:24.948028 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:24.948036 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:24.948234 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:24.948376 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:24.950033 (+ 1657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:24.950041 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:24.950054 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:24.950082 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:24.950143 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:24.950164 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:24.950344 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:24.950434 (+ 90us) server_negotiation.cc:299] Negotiation successful
0806 10:41:24.950525 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2795,"thread_start_us":2670,"threads_started":1}
I20260806 10:41:24.951257 24493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:24.944583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:44139 (local address 127.0.0.1:53006)
0806 10:41:24.947354 (+ 2771us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:24.947376 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:24.947459 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:24.948837 (+ 1378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:24.948841 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:24.948862 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:24.949834 (+ 972us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:41:24.949837 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:24.949851 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:41:24.949904 (+ 53us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:24.950278 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:24.950283 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:24.950288 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 10:41:24.950482 (+ 194us) client_negotiation.cc:240] Negotiation successful
0806 10:41:24.950533 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2664,"thread_start_us":2537,"threads_started":1}
I20260806 10:41:24.952605 23954 tablet_service.cc:1467] Processing CreateTablet for tablet 68d4ed95159a438c8cc7e0275ee0355b (DEFAULT_TABLE table=test-table [id=62d474f696314bb3a2d5185737bfb92a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:24.954043 23954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68d4ed95159a438c8cc7e0275ee0355b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:24.954259 24169 tablet_service.cc:1467] Processing CreateTablet for tablet 68d4ed95159a438c8cc7e0275ee0355b (DEFAULT_TABLE table=test-table [id=62d474f696314bb3a2d5185737bfb92a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:24.954259 24370 tablet_service.cc:1467] Processing CreateTablet for tablet 68d4ed95159a438c8cc7e0275ee0355b (DEFAULT_TABLE table=test-table [id=62d474f696314bb3a2d5185737bfb92a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:24.955538 24169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68d4ed95159a438c8cc7e0275ee0355b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:24.955538 24370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68d4ed95159a438c8cc7e0275ee0355b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:24.965265 24497 tablet_bootstrap.cc:492] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7: Bootstrap starting.
I20260806 10:41:24.968358 24497 tablet_bootstrap.cc:654] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:24.969341 24498 tablet_bootstrap.cc:492] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6: Bootstrap starting.
I20260806 10:41:24.969550 24497 log.cc:824] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:24.970391 24499 tablet_bootstrap.cc:492] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf: Bootstrap starting.
I20260806 10:41:24.973171 24498 tablet_bootstrap.cc:654] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:24.973800 24497 tablet_bootstrap.cc:492] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7: No bootstrap required, opened a new log
I20260806 10:41:24.974071 24497 ts_tablet_manager.cc:1397] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.001s
I20260806 10:41:24.974169 24498 log.cc:824] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:24.974238 24499 tablet_bootstrap.cc:654] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:24.975453 24499 log.cc:824] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:24.976722 24498 tablet_bootstrap.cc:492] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6: No bootstrap required, opened a new log
I20260806 10:41:24.976953 24498 ts_tablet_manager.cc:1397] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 10:41:24.978299 24499 tablet_bootstrap.cc:492] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf: No bootstrap required, opened a new log
I20260806 10:41:24.978598 24499 ts_tablet_manager.cc:1397] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.007s
I20260806 10:41:24.983966 24498 raft_consensus.cc:348] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ae8f489118c4880a20e762fc6564baf" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39389 } } peers { permanent_uuid: "18126a6b061c4957957db885ded25db7" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35755 } } peers { permanent_uuid: "2d53832f691c40389a6352cdf476f8e6" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44139 } }
I20260806 10:41:24.984319 24498 raft_consensus.cc:374] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:24.984431 24498 raft_consensus.cc:729] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d53832f691c40389a6352cdf476f8e6, State: Initialized, Role: FOLLOWER
I20260806 10:41:24.984535 24497 raft_consensus.cc:348] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ae8f489118c4880a20e762fc6564baf" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39389 } } peers { permanent_uuid: "18126a6b061c4957957db885ded25db7" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35755 } } peers { permanent_uuid: "2d53832f691c40389a6352cdf476f8e6" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44139 } }
I20260806 10:41:24.984962 24497 raft_consensus.cc:374] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:24.985059 24497 raft_consensus.cc:729] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18126a6b061c4957957db885ded25db7, State: Initialized, Role: FOLLOWER
I20260806 10:41:24.985016 24498 consensus_queue.cc:260] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ae8f489118c4880a20e762fc6564baf" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39389 } } peers { permanent_uuid: "18126a6b061c4957957db885ded25db7" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35755 } } peers { permanent_uuid: "2d53832f691c40389a6352cdf476f8e6" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44139 } }
I20260806 10:41:24.985714 24497 consensus_queue.cc:260] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ae8f489118c4880a20e762fc6564baf" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39389 } } peers { permanent_uuid: "18126a6b061c4957957db885ded25db7" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35755 } } peers { permanent_uuid: "2d53832f691c40389a6352cdf476f8e6" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44139 } }
I20260806 10:41:24.986135 24274 heartbeater.cc:503] Master 127.16.45.126:33019 was elected leader, sending a full tablet report...
I20260806 10:41:24.986752 24498 ts_tablet_manager.cc:1428] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260806 10:41:24.986909 24063 heartbeater.cc:503] Master 127.16.45.126:33019 was elected leader, sending a full tablet report...
I20260806 10:41:24.987557 24497 ts_tablet_manager.cc:1428] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7: Time spent starting tablet: real 0.013s user 0.011s sys 0.004s
I20260806 10:41:24.989270 24499 raft_consensus.cc:348] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ae8f489118c4880a20e762fc6564baf" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39389 } } peers { permanent_uuid: "18126a6b061c4957957db885ded25db7" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35755 } } peers { permanent_uuid: "2d53832f691c40389a6352cdf476f8e6" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44139 } }
I20260806 10:41:24.989591 24499 raft_consensus.cc:374] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:24.989681 24499 raft_consensus.cc:729] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ae8f489118c4880a20e762fc6564baf, State: Initialized, Role: FOLLOWER
I20260806 10:41:24.990226 24499 consensus_queue.cc:260] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ae8f489118c4880a20e762fc6564baf" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39389 } } peers { permanent_uuid: "18126a6b061c4957957db885ded25db7" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35755 } } peers { permanent_uuid: "2d53832f691c40389a6352cdf476f8e6" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44139 } }
I20260806 10:41:24.991281 24468 heartbeater.cc:503] Master 127.16.45.126:33019 was elected leader, sending a full tablet report...
I20260806 10:41:24.991974 24499 ts_tablet_manager.cc:1428] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf: Time spent starting tablet: real 0.013s user 0.009s sys 0.002s
W20260806 10:41:25.010517 24065 tablet.cc:2369] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:41:25.065207 24507 raft_consensus.cc:482] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:25.065706 24507 raft_consensus.cc:504] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ae8f489118c4880a20e762fc6564baf" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39389 } } peers { permanent_uuid: "18126a6b061c4957957db885ded25db7" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35755 } } peers { permanent_uuid: "2d53832f691c40389a6352cdf476f8e6" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44139 } }
I20260806 10:41:25.067629 24507 leader_election.cc:288] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ae8f489118c4880a20e762fc6564baf (127.16.45.67:39389), 2d53832f691c40389a6352cdf476f8e6 (127.16.45.66:44139)
I20260806 10:41:25.071288 24488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.068113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:37887 (local address 127.16.45.67:39389)
0806 10:41:25.068387 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:25.068394 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:25.069087 (+ 693us) server_negotiation.cc:407] Connection header received
0806 10:41:25.069278 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:25.069283 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:25.069334 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:25.069441 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:25.070652 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:25.070658 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:25.070663 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:25.070682 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:25.070721 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:25.070736 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:25.070866 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:25.070968 (+ 102us) server_negotiation.cc:299] Negotiation successful
0806 10:41:25.071030 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260806 10:41:25.071282 24496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.068156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:48659 (local address 127.16.45.66:44139)
0806 10:41:25.068346 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:25.068353 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:25.069169 (+ 816us) server_negotiation.cc:407] Connection header received
0806 10:41:25.069262 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:25.069267 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:25.069334 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:25.069465 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:25.070653 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:25.070658 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:25.070663 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:25.070682 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:25.070721 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:25.070737 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:25.070863 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:25.070968 (+ 105us) server_negotiation.cc:299] Negotiation successful
0806 10:41:25.071037 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 10:41:25.071688 24510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.068016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:44139 (local address 127.16.45.65:48659)
0806 10:41:25.069056 (+ 1040us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:25.069072 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:25.069161 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:25.069482 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:25.069488 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:25.069515 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:25.070420 (+ 905us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:41:25.070423 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:25.070440 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:41:25.070497 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:25.070833 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:25.070839 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:25.070844 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 10:41:25.071030 (+ 186us) client_negotiation.cc:240] Negotiation successful
0806 10:41:25.071066 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":924,"thread_start_us":413,"threads_started":1}
I20260806 10:41:25.071710 24512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.067947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:39389 (local address 127.16.45.65:37887)
0806 10:41:25.068959 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:25.068981 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:25.069132 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:25.069482 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:25.069488 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:25.069515 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:25.070416 (+ 901us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:41:25.070420 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:25.070440 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:41:25.070497 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:25.070833 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:25.070839 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:25.070844 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 10:41:25.071002 (+ 158us) client_negotiation.cc:240] Negotiation successful
0806 10:41:25.071066 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":858,"thread_start_us":642,"threads_started":1}
I20260806 10:41:25.072623 24403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68d4ed95159a438c8cc7e0275ee0355b" candidate_uuid: "18126a6b061c4957957db885ded25db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ae8f489118c4880a20e762fc6564baf" is_pre_election: true
I20260806 10:41:25.072731 24200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68d4ed95159a438c8cc7e0275ee0355b" candidate_uuid: "18126a6b061c4957957db885ded25db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d53832f691c40389a6352cdf476f8e6" is_pre_election: true
I20260806 10:41:25.073168 24403 raft_consensus.cc:2454] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18126a6b061c4957957db885ded25db7 in term 0.
I20260806 10:41:25.073268 24200 raft_consensus.cc:2454] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18126a6b061c4957957db885ded25db7 in term 0.
I20260806 10:41:25.073853 23877 leader_election.cc:302] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18126a6b061c4957957db885ded25db7, 6ae8f489118c4880a20e762fc6564baf; no voters:
I20260806 10:41:25.074244 24507 raft_consensus.cc:2781] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:25.074435 24507 raft_consensus.cc:482] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:25.074554 24507 raft_consensus.cc:3037] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:25.076826 24507 raft_consensus.cc:504] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ae8f489118c4880a20e762fc6564baf" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39389 } } peers { permanent_uuid: "18126a6b061c4957957db885ded25db7" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35755 } } peers { permanent_uuid: "2d53832f691c40389a6352cdf476f8e6" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44139 } }
I20260806 10:41:25.077502 24507 leader_election.cc:288] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [CANDIDATE]: Term 1 election: Requested vote from peers 6ae8f489118c4880a20e762fc6564baf (127.16.45.67:39389), 2d53832f691c40389a6352cdf476f8e6 (127.16.45.66:44139)
I20260806 10:41:25.077953 24403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68d4ed95159a438c8cc7e0275ee0355b" candidate_uuid: "18126a6b061c4957957db885ded25db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ae8f489118c4880a20e762fc6564baf"
I20260806 10:41:25.078111 24200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68d4ed95159a438c8cc7e0275ee0355b" candidate_uuid: "18126a6b061c4957957db885ded25db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d53832f691c40389a6352cdf476f8e6"
I20260806 10:41:25.078203 24403 raft_consensus.cc:3037] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:25.078416 24200 raft_consensus.cc:3037] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:25.081691 24200 raft_consensus.cc:2454] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18126a6b061c4957957db885ded25db7 in term 1.
I20260806 10:41:25.081691 24403 raft_consensus.cc:2454] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18126a6b061c4957957db885ded25db7 in term 1.
I20260806 10:41:25.082123 23877 leader_election.cc:302] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18126a6b061c4957957db885ded25db7, 6ae8f489118c4880a20e762fc6564baf; no voters:
I20260806 10:41:25.082468 24507 raft_consensus.cc:2781] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:25.082933 24507 raft_consensus.cc:686] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 1 LEADER]: Becoming Leader. State: Replica: 18126a6b061c4957957db885ded25db7, State: Running, Role: LEADER
I20260806 10:41:25.083458 24507 consensus_queue.cc:237] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ae8f489118c4880a20e762fc6564baf" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39389 } } peers { permanent_uuid: "18126a6b061c4957957db885ded25db7" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35755 } } peers { permanent_uuid: "2d53832f691c40389a6352cdf476f8e6" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44139 } }
I20260806 10:41:25.087908 23755 catalog_manager.cc:5495] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18126a6b061c4957957db885ded25db7 (127.16.45.65). New cstate: current_term: 1 leader_uuid: "18126a6b061c4957957db885ded25db7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ae8f489118c4880a20e762fc6564baf" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18126a6b061c4957957db885ded25db7" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d53832f691c40389a6352cdf476f8e6" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44139 } health_report { overall_health: UNKNOWN } } }
I20260806 10:41:25.105283 24489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.102977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43658 (local address 127.16.45.65:35755)
0806 10:41:25.103157 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:25.103165 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:25.103288 (+ 123us) server_negotiation.cc:407] Connection header received
0806 10:41:25.103535 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:25.103540 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:25.103627 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:25.103735 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:25.104619 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:25.104626 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:25.104631 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:25.104650 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:25.104684 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:25.104697 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:25.104811 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:25.104918 (+ 107us) server_negotiation.cc:299] Negotiation successful
0806 10:41:25.104985 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 10:41:25.113603 24403 raft_consensus.cc:1261] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf [term 1 FOLLOWER]: Refusing update from remote peer 18126a6b061c4957957db885ded25db7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:25.113603 24200 raft_consensus.cc:1261] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6 [term 1 FOLLOWER]: Refusing update from remote peer 18126a6b061c4957957db885ded25db7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:25.114683 24513 consensus_queue.cc:1035] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ae8f489118c4880a20e762fc6564baf" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:25.115082 24507 consensus_queue.cc:1035] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d53832f691c40389a6352cdf476f8e6" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:25.125610 24518 mvcc.cc:205] Tried to move back new op lower bound from 7315508777415139328 to 7315508777305350144. Current Snapshot: MvccSnapshot[applied={T|T < 7315508777415139328}]
I20260806 10:41:25.146289 23756 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:25.146584 23756 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:25.150353 23756 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7ad65706c1e24e869ebeab6ec6317c6e: Sending DeleteTablet for 3 replicas of tablet 68d4ed95159a438c8cc7e0275ee0355b
I20260806 10:41:25.151448 24370 tablet_service.cc:1514] Processing DeleteTablet for tablet 68d4ed95159a438c8cc7e0275ee0355b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:25 UTC) from {username='slave'} at 127.0.0.1:33454
I20260806 10:41:25.151511 23954 tablet_service.cc:1514] Processing DeleteTablet for tablet 68d4ed95159a438c8cc7e0275ee0355b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:25 UTC) from {username='slave'} at 127.0.0.1:43656
I20260806 10:41:25.151532 24169 tablet_service.cc:1514] Processing DeleteTablet for tablet 68d4ed95159a438c8cc7e0275ee0355b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:25 UTC) from {username='slave'} at 127.0.0.1:53006
I20260806 10:41:25.153682 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 23853
I20260806 10:41:25.162624 24537 tablet_replica.cc:330] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6: stopping tablet replica
I20260806 10:41:25.163098 24537 raft_consensus.cc:2229] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:25.163618 24537 raft_consensus.cc:2258] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:25.164489 24536 tablet_replica.cc:330] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf: stopping tablet replica
I20260806 10:41:25.164884 24536 raft_consensus.cc:2229] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:25.165344 24536 raft_consensus.cc:2258] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:25.167742 24537 ts_tablet_manager.cc:1905] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:25.171612 24536 ts_tablet_manager.cc:1905] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:25.172403 24535 tablet_replica.cc:330] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7: stopping tablet replica
I20260806 10:41:25.174850 24537 ts_tablet_manager.cc:1918] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:25.175009 24537 log.cc:1196] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/68d4ed95159a438c8cc7e0275ee0355b
I20260806 10:41:25.175478 24535 raft_consensus.cc:2229] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:41:25.175596 24537 ts_tablet_manager.cc:1939] T 68d4ed95159a438c8cc7e0275ee0355b P 2d53832f691c40389a6352cdf476f8e6: Deleting consensus metadata
I20260806 10:41:25.176339 24489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.156295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43672 (local address 127.16.45.65:35755)
0806 10:41:25.156811 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:25.156818 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:25.173257 (+ 16439us) server_negotiation.cc:407] Connection header received
0806 10:41:25.173574 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:25.173580 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:25.173649 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:25.173760 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:25.175424 (+ 1664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:25.175430 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:25.175434 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:25.175455 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:25.175497 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:25.175513 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:25.175629 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:25.175937 (+ 308us) server_negotiation.cc:299] Negotiation successful
0806 10:41:25.176001 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372}
I20260806 10:41:25.176309 24535 raft_consensus.cc:2258] T 68d4ed95159a438c8cc7e0275ee0355b P 18126a6b061c4957957db885ded25db7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:25.177345 24056 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:25.178035 23734 catalog_manager.cc:4841] TS 2d53832f691c40389a6352cdf476f8e6 (127.16.45.66:44139): tablet 68d4ed95159a438c8cc7e0275ee0355b (table test-table [id=62d474f696314bb3a2d5185737bfb92a]) successfully deleted
I20260806 10:41:25.181651 24536 ts_tablet_manager.cc:1918] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:25.181846 24536 log.cc:1196] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/68d4ed95159a438c8cc7e0275ee0355b
I20260806 10:41:25.182436 24536 ts_tablet_manager.cc:1939] T 68d4ed95159a438c8cc7e0275ee0355b P 6ae8f489118c4880a20e762fc6564baf: Deleting consensus metadata
I20260806 10:41:25.184229 23735 catalog_manager.cc:4841] TS 6ae8f489118c4880a20e762fc6564baf (127.16.45.67:39389): tablet 68d4ed95159a438c8cc7e0275ee0355b (table test-table [id=62d474f696314bb3a2d5185737bfb92a]) successfully deleted
I20260806 10:41:25.273770 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 23853
W20260806 10:41:25.297642 23734 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.45.65:35755 (error 108)
I20260806 10:41:25.297770 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 24069
I20260806 10:41:25.299642 24493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.299229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35755 (local address 127.0.0.1:43686)
0806 10:41:25.299385 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:25.299514 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260806 10:41:25.299858 23734 catalog_manager.cc:4584] TS 18126a6b061c4957957db885ded25db7 (127.16.45.65:35755): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 68d4ed95159a438c8cc7e0275ee0355b: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35755: connect: Connection refused (error 111)
I20260806 10:41:25.300997 24496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.298756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53022 (local address 127.16.45.66:44139)
0806 10:41:25.298948 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:25.298954 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:25.299061 (+ 107us) server_negotiation.cc:407] Connection header received
0806 10:41:25.299224 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:25.299228 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:25.299346 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:25.299441 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:25.300418 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:25.300422 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:25.300425 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:25.300439 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:25.300470 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:25.300482 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:25.300592 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:25.300679 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 10:41:25.300739 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 10:41:25.301694 24261 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:25.353551 24493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.352945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35755 (local address 127.0.0.1:43692)
0806 10:41:25.353192 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:25.353337 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260806 10:41:25.354686 24493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.354277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35755 (local address 127.0.0.1:43694)
0806 10:41:25.354454 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:25.354544 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 10:41:25.390425 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 24069
I20260806 10:41:25.409312 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 24280
I20260806 10:41:25.411942 24488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.410024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33464 (local address 127.16.45.67:39389)
0806 10:41:25.410179 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:25.410183 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:25.410220 (+ 37us) server_negotiation.cc:407] Connection header received
0806 10:41:25.410472 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:25.410477 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:25.410559 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:25.410637 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:25.411473 (+ 836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:25.411477 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:25.411479 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:25.411491 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:25.411515 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:25.411526 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:25.411621 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:25.411661 (+ 40us) server_negotiation.cc:299] Negotiation successful
0806 10:41:25.411706 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 10:41:25.412549 24462 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:25.415373 24493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.414901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35755 (local address 127.0.0.1:43702)
0806 10:41:25.415100 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:25.415210 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 10:41:25.416492 24493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.416070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35755 (local address 127.0.0.1:43708)
0806 10:41:25.416243 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:25.416335 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 10:41:25.497303 24493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.496824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35755 (local address 127.0.0.1:43722)
0806 10:41:25.497048 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:25.497162 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260806 10:41:25.498387 24493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:25.497935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35755 (local address 127.0.0.1:43734)
0806 10:41:25.498151 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:25.498220 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260806 10:41:25.501130 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 24280
I20260806 10:41:25.521993 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 23714
I20260806 10:41:25.523201 23805 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:25.629088 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 23714
2026-08-06T10:41:25Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2622 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 10:41:25.673779 16565 mini_oidc.cc:152] Starting JWKS server
I20260806 10:41:25.676752 16565 webserver.cc:460] Webserver started at https://127.0.0.1:34957/ using document root <none> and password file <none>
I20260806 10:41:25.677074 16565 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 10:41:25.677675 16565 webserver.cc:460] Webserver started at http://127.0.0.1:33677/ using document root <none> and password file <none>
2026-08-06T10:41:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:25Z Disabled control of system clock
I20260806 10:41:25.706555 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:37251
--webserver_interface=127.16.45.126
--webserver_port=0
--builtin_ntp_servers=127.16.45.84:37161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:37251
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34957/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/testchainca.cert with env {}
W20260806 10:41:26.034883 24552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:26.035182 24552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:26.035284 24552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:26.042680 24552 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:26.042807 24552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:26.042845 24552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:26.042901 24552 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:26.042945 24552 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 10:41:26.043004 24552 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 10:41:26.043046 24552 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34957/jwks.json
I20260806 10:41:26.053164 24552 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:37161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:37251
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:37251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34957/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:26.054499 24552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:26.055789 24552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:26.067314 24561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:26.067323 24564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:26.067405 24560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:26.068454 24552 server_base.cc:1034] running on GCE node
I20260806 10:41:26.069177 24552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:26.070629 24552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:26.071828 24552 hybrid_clock.cc:648] HybridClock initialized: now 1786012886071786 us; error 32 us; skew 500 ppm
I20260806 10:41:26.072151 24552 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:41:26.074301 24552 webserver.cc:460] Webserver started at http://127.16.45.126:46559/ using document root <none> and password file <none>
I20260806 10:41:26.075001 24552 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:26.075099 24552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:26.075390 24552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:26.078166 24552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "51eac2b0ef1d4427b31dd52942a181d3"
format_stamp: "Formatted at 2026-08-06 10:41:26 on dist-test-slave-fgb3"
server_key: "2cb3aa895b57cddc2bb95404e742f42f"
server_key_iv: "ec2f038eb2da8cc8ca7bf1aed9b38f5d"
server_key_version: "encryptionkey@0"
I20260806 10:41:26.078935 24552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "51eac2b0ef1d4427b31dd52942a181d3"
format_stamp: "Formatted at 2026-08-06 10:41:26 on dist-test-slave-fgb3"
server_key: "2cb3aa895b57cddc2bb95404e742f42f"
server_key_iv: "ec2f038eb2da8cc8ca7bf1aed9b38f5d"
server_key_version: "encryptionkey@0"
I20260806 10:41:26.084086 24552 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 10:41:26.087370 24576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:26.088605 24552 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 10:41:26.088762 24552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "51eac2b0ef1d4427b31dd52942a181d3"
format_stamp: "Formatted at 2026-08-06 10:41:26 on dist-test-slave-fgb3"
server_key: "2cb3aa895b57cddc2bb95404e742f42f"
server_key_iv: "ec2f038eb2da8cc8ca7bf1aed9b38f5d"
server_key_version: "encryptionkey@0"
I20260806 10:41:26.088967 24552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:26.114013 24552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:26.114898 24552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:26.115197 24552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:26.132756 24552 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:37251
I20260806 10:41:26.132767 24654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:37251 every 8 connection(s)
I20260806 10:41:26.134066 24552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:26.136477 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 24552
I20260806 10:41:26.136669 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:26.137307 16565 external_mini_cluster.cc:1428] Setting key 069980a3717de7f601937e2ecd68de05
I20260806 10:41:26.137907 24657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:26.152678 24657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3: Bootstrap starting.
I20260806 10:41:26.152916 24662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:26.139154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48604 (local address 127.16.45.126:37251)
0806 10:41:26.140248 (+ 1094us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:26.140262 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:26.140329 (+ 67us) server_negotiation.cc:407] Connection header received
0806 10:41:26.142711 (+ 2382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:26.142745 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:26.143358 (+ 613us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:26.143806 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:26.144343 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:26.146333 (+ 1990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:26.147815 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:26.148800 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:26.148983 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:26.150137 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:26.150148 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:26.150165 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:26.150912 (+ 747us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:26.151004 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:26.151036 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:26.151144 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:26.151376 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 10:41:26.151678 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":355,"threads_started":1}
I20260806 10:41:26.155968 24657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:26.156471 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:41:26.156998 24657 log.cc:824] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:26.159788 24657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3: No bootstrap required, opened a new log
I20260806 10:41:26.167073 24657 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eac2b0ef1d4427b31dd52942a181d3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37251 } }
I20260806 10:41:26.167435 24657 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:26.167541 24657 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51eac2b0ef1d4427b31dd52942a181d3, State: Initialized, Role: FOLLOWER
I20260806 10:41:26.168135 24657 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eac2b0ef1d4427b31dd52942a181d3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37251 } }
I20260806 10:41:26.168409 24657 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:26.168524 24657 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:26.168648 24657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:26.170779 24657 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eac2b0ef1d4427b31dd52942a181d3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37251 } }
I20260806 10:41:26.171221 24657 leader_election.cc:302] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51eac2b0ef1d4427b31dd52942a181d3; no voters:
I20260806 10:41:26.171737 24657 leader_election.cc:288] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:26.171885 24664 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:26.172526 24664 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [term 1 LEADER]: Becoming Leader. State: Replica: 51eac2b0ef1d4427b31dd52942a181d3, State: Running, Role: LEADER
I20260806 10:41:26.173007 24664 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eac2b0ef1d4427b31dd52942a181d3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37251 } }
I20260806 10:41:26.173785 24657 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:26.175673 24665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51eac2b0ef1d4427b31dd52942a181d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eac2b0ef1d4427b31dd52942a181d3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37251 } } }
I20260806 10:41:26.175684 24666 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51eac2b0ef1d4427b31dd52942a181d3. Latest consensus state: current_term: 1 leader_uuid: "51eac2b0ef1d4427b31dd52942a181d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51eac2b0ef1d4427b31dd52942a181d3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37251 } } }
I20260806 10:41:26.176118 24666 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:26.176118 24665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:26.178129 24676 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:26.182888 24676 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:26.191012 24676 catalog_manager.cc:1347] Generated new cluster ID: 6227cffe1c42447b9720f1fe1bfce745
I20260806 10:41:26.191134 24676 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:26.207139 24676 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:26.208461 24676 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:26.216233 24676 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51eac2b0ef1d4427b31dd52942a181d3: Generated new TSK 0
I20260806 10:41:26.217303 24676 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 10:41:26.259660 24699 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 10:41:26.259900 24699 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 10:41:26.260936 24662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:26.239222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48606 (local address 127.16.45.126:37251)
0806 10:41:26.239463 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:26.239469 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:26.239928 (+ 459us) server_negotiation.cc:407] Connection header received
0806 10:41:26.240332 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:26.240335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:26.240436 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:26.240559 (+ 123us) server_negotiation.cc:226] Negotiated authn=JWT
0806 10:41:26.241198 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:26.241949 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:26.244093 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:26.244583 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:26.244706 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:26.245370 (+ 664us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 10:41:26.260358 (+ 14988us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34957/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 10:41:26.260689 (+ 331us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48606: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34957/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":77}
W20260806 10:41:26.261052 24662 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48606: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34957/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260806 10:41:26.264187 24698 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:41:26.239106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:37251 (local address 127.0.0.1:48606)
0806 10:41:26.239817 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:26.239837 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:26.240038 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:26.240611 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:26.240617 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:26.240630 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0806 10:41:26.241052 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:26.241065 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:26.242091 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:26.242097 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:26.243905 (+ 1808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:26.243923 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:26.244756 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:26.244762 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:26.244964 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:26.245056 (+ 92us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 10:41:26.260685 (+ 15629us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34957/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 10:41:26.261068 (+ 383us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.16.45.126:37251: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34957/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":332,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.16.45.126:37251: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34957/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 10:41:26.266290 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 24552
I20260806 10:41:26.267546 24648 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:26.361801 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 24552
2026-08-06T10:41:26Z chronyd exiting
I20260806 10:41:26.414513 16565 test_util.cc:175] -----------------------------------------------
I20260806 10:41:26.414665 16565 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786012840862403-16565-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (745 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 10:41:26.418789 16565 mini_oidc.cc:152] Starting JWKS server
I20260806 10:41:26.420639 16565 webserver.cc:460] Webserver started at https://127.0.0.1:38075/ using document root <none> and password file <none>
I20260806 10:41:26.420852 16565 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 10:41:26.421514 16565 webserver.cc:460] Webserver started at http://127.0.0.1:43049/ using document root <none> and password file <none>
2026-08-06T10:41:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:26Z Disabled control of system clock
I20260806 10:41:26.453665 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:41243
--webserver_interface=127.16.45.126
--webserver_port=0
--builtin_ntp_servers=127.16.45.84:34181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:41243
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38075/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/testchainca.cert with env {}
W20260806 10:41:26.780371 24711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:26.780686 24711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:26.780833 24711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:26.788131 24711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:26.788251 24711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:26.788321 24711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:26.788401 24711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:26.788461 24711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 10:41:26.788546 24711 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 10:41:26.788600 24711 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38075/jwks.json
I20260806 10:41:26.799049 24711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:41243
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:41243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38075/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:26.800444 24711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:26.801734 24711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:26.814163 24723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:26.814108 24731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:26.814152 24728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:26.814978 24711 server_base.cc:1034] running on GCE node
I20260806 10:41:26.815785 24711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:26.817209 24711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:26.818403 24711 hybrid_clock.cc:648] HybridClock initialized: now 1786012886818351 us; error 39 us; skew 500 ppm
I20260806 10:41:26.818738 24711 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:41:26.826165 24711 webserver.cc:460] Webserver started at http://127.16.45.126:44143/ using document root <none> and password file <none>
I20260806 10:41:26.826965 24711 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:26.827082 24711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:26.827416 24711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:26.830374 24711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "bb694bfc964a4947b4c824b40a0a5924"
format_stamp: "Formatted at 2026-08-06 10:41:26 on dist-test-slave-fgb3"
server_key: "7e964877ad7ff09d136f31f64f94e69f"
server_key_iv: "efd7238d3cb6ecf0e581250315d52b73"
server_key_version: "encryptionkey@0"
I20260806 10:41:26.831188 24711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "bb694bfc964a4947b4c824b40a0a5924"
format_stamp: "Formatted at 2026-08-06 10:41:26 on dist-test-slave-fgb3"
server_key: "7e964877ad7ff09d136f31f64f94e69f"
server_key_iv: "efd7238d3cb6ecf0e581250315d52b73"
server_key_version: "encryptionkey@0"
I20260806 10:41:26.836237 24711 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:41:26.839773 24740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:26.841071 24711 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:41:26.841346 24711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "bb694bfc964a4947b4c824b40a0a5924"
format_stamp: "Formatted at 2026-08-06 10:41:26 on dist-test-slave-fgb3"
server_key: "7e964877ad7ff09d136f31f64f94e69f"
server_key_iv: "efd7238d3cb6ecf0e581250315d52b73"
server_key_version: "encryptionkey@0"
I20260806 10:41:26.841586 24711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:26.864377 24711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:26.865227 24711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:26.865533 24711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:26.883913 24711 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:41243
I20260806 10:41:26.883932 24823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:41243 every 8 connection(s)
I20260806 10:41:26.885243 24711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:26.886622 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 24711
I20260806 10:41:26.886837 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:26.887669 16565 external_mini_cluster.cc:1428] Setting key 54bc625d8755dab739451bdc65beccb5
I20260806 10:41:26.889945 24824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:26.902107 24827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:26.889703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44192 (local address 127.16.45.126:41243)
0806 10:41:26.890767 (+ 1064us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:26.890778 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:26.890824 (+ 46us) server_negotiation.cc:407] Connection header received
0806 10:41:26.892502 (+ 1678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:26.892524 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:26.893000 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:26.893372 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:26.893948 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:26.895557 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:26.897387 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:26.898104 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:26.898298 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:26.899547 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:26.899557 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:26.899571 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:26.900203 (+ 632us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:26.900343 (+ 140us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:26.900371 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:26.900475 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:26.900722 (+ 247us) server_negotiation.cc:299] Negotiation successful
0806 10:41:26.901081 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":364,"threads_started":1}
I20260806 10:41:26.902805 24824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924: Bootstrap starting.
I20260806 10:41:26.905979 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:41:26.906179 24824 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:26.907181 24824 log.cc:824] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:26.910194 24824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924: No bootstrap required, opened a new log
I20260806 10:41:26.917449 24824 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb694bfc964a4947b4c824b40a0a5924" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41243 } }
I20260806 10:41:26.917793 24824 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:26.917897 24824 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb694bfc964a4947b4c824b40a0a5924, State: Initialized, Role: FOLLOWER
I20260806 10:41:26.918596 24824 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb694bfc964a4947b4c824b40a0a5924" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41243 } }
I20260806 10:41:26.918882 24824 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:26.919030 24824 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:26.919183 24824 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:26.921263 24824 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb694bfc964a4947b4c824b40a0a5924" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41243 } }
I20260806 10:41:26.921712 24824 leader_election.cc:302] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb694bfc964a4947b4c824b40a0a5924; no voters:
I20260806 10:41:26.922278 24824 leader_election.cc:288] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:26.922462 24834 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:26.923187 24834 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [term 1 LEADER]: Becoming Leader. State: Replica: bb694bfc964a4947b4c824b40a0a5924, State: Running, Role: LEADER
I20260806 10:41:26.923750 24834 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb694bfc964a4947b4c824b40a0a5924" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41243 } }
I20260806 10:41:26.924443 24824 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:26.926215 24837 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb694bfc964a4947b4c824b40a0a5924. Latest consensus state: current_term: 1 leader_uuid: "bb694bfc964a4947b4c824b40a0a5924" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb694bfc964a4947b4c824b40a0a5924" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41243 } } }
I20260806 10:41:26.927203 24837 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:26.926728 24835 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb694bfc964a4947b4c824b40a0a5924" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb694bfc964a4947b4c824b40a0a5924" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41243 } } }
I20260806 10:41:26.927589 24835 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:26.929296 24845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:26.934448 24845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:26.943444 24845 catalog_manager.cc:1347] Generated new cluster ID: 94bce17d721247c5adfeab3c89dc5aa5
I20260806 10:41:26.943581 24845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:26.973645 24845 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:26.975591 24845 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:26.981704 24845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb694bfc964a4947b4c824b40a0a5924: Generated new TSK 0
I20260806 10:41:26.982549 24845 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 10:41:27.020671 24874 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 10:41:27.020830 24874 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 10:41:27.021895 24827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:27.001220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44198 (local address 127.16.45.126:41243)
0806 10:41:27.001486 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:27.001492 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:27.001802 (+ 310us) server_negotiation.cc:407] Connection header received
0806 10:41:27.002018 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:27.002022 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:27.002093 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:27.002228 (+ 135us) server_negotiation.cc:226] Negotiated authn=JWT
0806 10:41:27.002789 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:27.003558 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:27.005609 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:27.006090 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:27.006199 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:27.006838 (+ 639us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 10:41:27.021311 (+ 14473us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38075/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 10:41:27.021639 (+ 328us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44198: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38075/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":143}
W20260806 10:41:27.022025 24827 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44198: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38075/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260806 10:41:27.022359 24873 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:41:27.001019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:41243 (local address 127.0.0.1:44198)
0806 10:41:27.001665 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:27.001689 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:27.001859 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:27.002260 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:27.002265 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:27.002279 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0806 10:41:27.002619 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:27.002632 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:27.003695 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:27.003701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:27.005439 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:27.005456 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:27.006275 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:27.006282 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:27.006508 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:27.006557 (+ 49us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 10:41:27.021602 (+ 15045us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38075/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 10:41:27.021922 (+ 320us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.16.45.126:41243: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38075/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":341,"threads_started":1}
I20260806 10:41:27.023577 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 24711
I20260806 10:41:27.024688 24814 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:27.118714 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 24711
2026-08-06T10:41:27Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (760 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 10:41:27.179435 16565 mini_oidc.cc:152] Starting JWKS server
I20260806 10:41:27.181388 16565 webserver.cc:460] Webserver started at https://127.0.0.1:40127/ using document root <none> and password file <none>
I20260806 10:41:27.181648 16565 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 10:41:27.182345 16565 webserver.cc:460] Webserver started at http://127.0.0.1:38843/ using document root <none> and password file <none>
2026-08-06T10:41:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:27Z Disabled control of system clock
I20260806 10:41:27.211947 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:43397
--webserver_interface=127.16.45.126
--webserver_port=0
--builtin_ntp_servers=127.16.45.84:42313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:43397
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40127/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 10:41:27.534258 24884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:27.534608 24884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:27.534742 24884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:27.542102 24884 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:27.542217 24884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:27.542279 24884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:27.542380 24884 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:27.542447 24884 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 10:41:27.542536 24884 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 10:41:27.542582 24884 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40127/jwks.json
I20260806 10:41:27.551954 24884 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:43397
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:43397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40127/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:27.553249 24884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:27.555091 24884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:27.566701 24891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:27.566732 24895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:27.566823 24892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:27.567533 24884 server_base.cc:1034] running on GCE node
I20260806 10:41:27.568328 24884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:27.569763 24884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:27.570978 24884 hybrid_clock.cc:648] HybridClock initialized: now 1786012887570933 us; error 31 us; skew 500 ppm
I20260806 10:41:27.571348 24884 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:41:27.573561 24884 webserver.cc:460] Webserver started at http://127.16.45.126:34887/ using document root <none> and password file <none>
I20260806 10:41:27.574234 24884 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:27.574358 24884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:27.574685 24884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:27.577508 24884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "abeb521c9d9e4ad881a3e760d2f57603"
format_stamp: "Formatted at 2026-08-06 10:41:27 on dist-test-slave-fgb3"
server_key: "531acf513e66ec154e1683cb1b20a3d1"
server_key_iv: "b916f1c78da6e6699aee00157981648c"
server_key_version: "encryptionkey@0"
I20260806 10:41:27.578292 24884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "abeb521c9d9e4ad881a3e760d2f57603"
format_stamp: "Formatted at 2026-08-06 10:41:27 on dist-test-slave-fgb3"
server_key: "531acf513e66ec154e1683cb1b20a3d1"
server_key_iv: "b916f1c78da6e6699aee00157981648c"
server_key_version: "encryptionkey@0"
I20260806 10:41:27.583361 24884 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 10:41:27.586706 24903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:27.588011 24884 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 10:41:27.588179 24884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "abeb521c9d9e4ad881a3e760d2f57603"
format_stamp: "Formatted at 2026-08-06 10:41:27 on dist-test-slave-fgb3"
server_key: "531acf513e66ec154e1683cb1b20a3d1"
server_key_iv: "b916f1c78da6e6699aee00157981648c"
server_key_version: "encryptionkey@0"
I20260806 10:41:27.588378 24884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:27.608937 24884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:27.609800 24884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:27.610098 24884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:27.635092 24884 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:43397
I20260806 10:41:27.635104 24985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:43397 every 8 connection(s)
I20260806 10:41:27.636502 24884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:27.640226 24987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:27.643311 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 24884
I20260806 10:41:27.643545 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:27.644315 16565 external_mini_cluster.cc:1428] Setting key 7930e57b144cc63f643ca9e1310a89fb
I20260806 10:41:27.652530 24987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603: Bootstrap starting.
I20260806 10:41:27.655573 24987 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:27.656585 24987 log.cc:824] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:27.657874 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:27.646491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45628 (local address 127.16.45.126:43397)
0806 10:41:27.647443 (+ 952us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:27.647454 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:27.647498 (+ 44us) server_negotiation.cc:407] Connection header received
0806 10:41:27.649237 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:27.649260 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:27.649764 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:27.650160 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:27.650813 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:27.652097 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:27.653520 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:27.654263 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:27.654499 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:27.655695 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:27.655706 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:27.655723 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:27.656278 (+ 555us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:27.656373 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:27.656393 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:27.656498 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:27.656717 (+ 219us) server_negotiation.cc:299] Negotiation successful
0806 10:41:27.657003 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":345,"threads_started":1}
I20260806 10:41:27.659318 24987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603: No bootstrap required, opened a new log
I20260806 10:41:27.661346 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:41:27.666751 24987 raft_consensus.cc:348] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abeb521c9d9e4ad881a3e760d2f57603" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 43397 } }
I20260806 10:41:27.667091 24987 raft_consensus.cc:374] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:27.667177 24987 raft_consensus.cc:729] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abeb521c9d9e4ad881a3e760d2f57603, State: Initialized, Role: FOLLOWER
I20260806 10:41:27.667727 24987 consensus_queue.cc:260] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abeb521c9d9e4ad881a3e760d2f57603" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 43397 } }
I20260806 10:41:27.667994 24987 raft_consensus.cc:388] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:27.668152 24987 raft_consensus.cc:482] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:27.668339 24987 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:27.670542 24987 raft_consensus.cc:504] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abeb521c9d9e4ad881a3e760d2f57603" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 43397 } }
I20260806 10:41:27.671034 24987 leader_election.cc:302] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abeb521c9d9e4ad881a3e760d2f57603; no voters:
I20260806 10:41:27.671623 24987 leader_election.cc:288] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:27.671753 24995 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:27.672837 24995 raft_consensus.cc:686] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [term 1 LEADER]: Becoming Leader. State: Replica: abeb521c9d9e4ad881a3e760d2f57603, State: Running, Role: LEADER
I20260806 10:41:27.673372 24995 consensus_queue.cc:237] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abeb521c9d9e4ad881a3e760d2f57603" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 43397 } }
I20260806 10:41:27.673734 24987 sys_catalog.cc:564] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:27.676414 24998 sys_catalog.cc:455] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abeb521c9d9e4ad881a3e760d2f57603. Latest consensus state: current_term: 1 leader_uuid: "abeb521c9d9e4ad881a3e760d2f57603" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abeb521c9d9e4ad881a3e760d2f57603" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 43397 } } }
I20260806 10:41:27.676453 24996 sys_catalog.cc:455] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abeb521c9d9e4ad881a3e760d2f57603" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abeb521c9d9e4ad881a3e760d2f57603" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 43397 } } }
I20260806 10:41:27.676842 24998 sys_catalog.cc:458] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:27.676849 24996 sys_catalog.cc:458] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:27.679230 25007 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:27.683434 25007 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:27.692762 25007 catalog_manager.cc:1347] Generated new cluster ID: 2752ffabc19d4a82bad89d7d4bda5a82
I20260806 10:41:27.692919 25007 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:27.706028 25007 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:27.707917 25007 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:27.718464 25007 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abeb521c9d9e4ad881a3e760d2f57603: Generated new TSK 0
I20260806 10:41:27.719527 25007 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:41:27.747140 24992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:27.739168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45642 (local address 127.16.45.126:43397)
0806 10:41:27.739412 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:27.739419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:27.739746 (+ 327us) server_negotiation.cc:407] Connection header received
0806 10:41:27.739987 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:27.739990 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:27.740061 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:27.740191 (+ 130us) server_negotiation.cc:226] Negotiated authn=JWT
0806 10:41:27.740723 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:27.741465 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:27.743512 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:27.743957 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:27.744050 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:27.744637 (+ 587us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 10:41:27.746505 (+ 1868us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40127/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 10:41:27.746822 (+ 317us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45642: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40127/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":83}
W20260806 10:41:27.747298 24992 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45642: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40127/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 10:41:27.747371 25031 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:41:27.739006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:43397 (local address 127.0.0.1:45642)
0806 10:41:27.739636 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:27.739657 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:27.739812 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:27.740226 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:27.740260 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:27.740274 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0806 10:41:27.740580 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:27.740591 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:27.741610 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:27.741616 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:27.743352 (+ 1736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:27.743368 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:27.744135 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:27.744142 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:27.744354 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:27.744401 (+ 47us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 10:41:27.746695 (+ 2294us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40127/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 10:41:27.746930 (+ 235us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.16.45.126:43397: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40127/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":337,"threads_started":1}
I20260806 10:41:27.748566 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 24884
I20260806 10:41:27.749686 24979 generic_service.cc:196] Checking for leaks (request via RPC)
E20260806 10:41:27.759217 25033 webserver.cc:533] Webserver: sslize failed:
E20260806 10:41:27.759330 25033 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 10:41:27.840700 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 24884
2026-08-06T10:41:27Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (715 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T10:41:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:27Z Disabled control of system clock
I20260806 10:41:27.926016 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:42439
--webserver_interface=127.16.45.126
--webserver_port=0
--builtin_ntp_servers=127.16.45.84:41719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:42439
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/testchainca.cert with env {}
W20260806 10:41:28.264930 25040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:28.265316 25040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:28.265472 25040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:28.272899 25040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:28.273016 25040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:28.273077 25040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:28.273155 25040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:28.273217 25040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 10:41:28.273298 25040 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 10:41:28.273355 25040 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 10:41:28.283741 25040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:42439
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:42439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:28.285089 25040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:28.286486 25040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:28.298019 25046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:28.298204 25050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:28.298336 25047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:28.299153 25040 server_base.cc:1034] running on GCE node
I20260806 10:41:28.299958 25040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:28.301403 25040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:28.302605 25040 hybrid_clock.cc:648] HybridClock initialized: now 1786012888302557 us; error 44 us; skew 500 ppm
I20260806 10:41:28.302944 25040 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:41:28.305199 25040 webserver.cc:460] Webserver started at http://127.16.45.126:33879/ using document root <none> and password file <none>
I20260806 10:41:28.305852 25040 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:28.305954 25040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:28.306210 25040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:28.309098 25040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "cbd9d5b575cc4e20a823f384cbfa5800"
format_stamp: "Formatted at 2026-08-06 10:41:28 on dist-test-slave-fgb3"
server_key: "1fc2d48d56fa36333c135427dd6d429e"
server_key_iv: "d05b4e2421a6bd8d614926d043cef739"
server_key_version: "encryptionkey@0"
I20260806 10:41:28.309839 25040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "cbd9d5b575cc4e20a823f384cbfa5800"
format_stamp: "Formatted at 2026-08-06 10:41:28 on dist-test-slave-fgb3"
server_key: "1fc2d48d56fa36333c135427dd6d429e"
server_key_iv: "d05b4e2421a6bd8d614926d043cef739"
server_key_version: "encryptionkey@0"
I20260806 10:41:28.314826 25040 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 10:41:28.318112 25057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:28.319458 25040 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:28.319595 25040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "cbd9d5b575cc4e20a823f384cbfa5800"
format_stamp: "Formatted at 2026-08-06 10:41:28 on dist-test-slave-fgb3"
server_key: "1fc2d48d56fa36333c135427dd6d429e"
server_key_iv: "d05b4e2421a6bd8d614926d043cef739"
server_key_version: "encryptionkey@0"
I20260806 10:41:28.319769 25040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:28.334779 25040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:28.335546 25040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:28.335779 25040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:28.353250 25040 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:42439
I20260806 10:41:28.353257 25143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:42439 every 8 connection(s)
I20260806 10:41:28.354631 25040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:28.358213 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 25040
I20260806 10:41:28.358362 25144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:28.358433 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:28.359082 16565 external_mini_cluster.cc:1428] Setting key 35e8fea77cd01c1916397e0df74768b4
I20260806 10:41:28.370292 25144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800: Bootstrap starting.
I20260806 10:41:28.372400 25150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:28.360898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34344 (local address 127.16.45.126:42439)
0806 10:41:28.361891 (+ 993us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:28.361901 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:28.361942 (+ 41us) server_negotiation.cc:407] Connection header received
0806 10:41:28.364278 (+ 2336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:28.364302 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:28.364776 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:28.365130 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:28.365671 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:28.366968 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:28.368214 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:28.368891 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:28.369048 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:28.370172 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:28.370180 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:28.370194 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:41:28.370771 (+ 577us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:28.370848 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:41:28.370873 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:28.370970 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:28.371193 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 10:41:28.371493 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":353,"threads_started":1}
I20260806 10:41:28.373709 25144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:28.374828 25144 log.cc:824] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:28.376334 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:41:28.377493 25144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800: No bootstrap required, opened a new log
I20260806 10:41:28.384493 25144 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd9d5b575cc4e20a823f384cbfa5800" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42439 } }
I20260806 10:41:28.384833 25144 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:28.384925 25144 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd9d5b575cc4e20a823f384cbfa5800, State: Initialized, Role: FOLLOWER
I20260806 10:41:28.385432 25144 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd9d5b575cc4e20a823f384cbfa5800" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42439 } }
I20260806 10:41:28.385628 25144 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:28.385756 25144 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:28.385901 25144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:28.388055 25144 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd9d5b575cc4e20a823f384cbfa5800" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42439 } }
I20260806 10:41:28.388527 25144 leader_election.cc:302] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbd9d5b575cc4e20a823f384cbfa5800; no voters:
I20260806 10:41:28.389125 25144 leader_election.cc:288] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:28.389302 25152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:28.390058 25152 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [term 1 LEADER]: Becoming Leader. State: Replica: cbd9d5b575cc4e20a823f384cbfa5800, State: Running, Role: LEADER
I20260806 10:41:28.390622 25152 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd9d5b575cc4e20a823f384cbfa5800" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42439 } }
I20260806 10:41:28.391398 25144 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:28.393330 25157 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbd9d5b575cc4e20a823f384cbfa5800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd9d5b575cc4e20a823f384cbfa5800" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42439 } } }
I20260806 10:41:28.393705 25157 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:28.398548 25159 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbd9d5b575cc4e20a823f384cbfa5800. Latest consensus state: current_term: 1 leader_uuid: "cbd9d5b575cc4e20a823f384cbfa5800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd9d5b575cc4e20a823f384cbfa5800" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42439 } } }
I20260806 10:41:28.398885 25159 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:28.401108 25166 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:28.406194 25166 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:28.414727 25166 catalog_manager.cc:1347] Generated new cluster ID: e818e2bac9c44d128c2e38ae68d8a2b7
I20260806 10:41:28.414851 25166 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:28.434675 25166 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:28.435945 25166 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:28.444517 25166 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbd9d5b575cc4e20a823f384cbfa5800: Generated new TSK 0
I20260806 10:41:28.445334 25166 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:41:28.555089 25150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:28.465246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34354 (local address 127.16.45.126:42439)
0806 10:41:28.465478 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:28.465485 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:28.465940 (+ 455us) server_negotiation.cc:407] Connection header received
0806 10:41:28.466168 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:28.466174 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:28.466268 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:28.466448 (+ 180us) server_negotiation.cc:226] Negotiated authn=JWT
0806 10:41:28.466852 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:28.468007 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:28.469566 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:28.470257 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:28.470426 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:28.470955 (+ 529us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 10:41:28.554302 (+ 83347us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 10:41:28.554755 (+ 453us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34354: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":77}
W20260806 10:41:28.555241 25150 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34354: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260806 10:41:28.555285 25196 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:41:28.465205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42439 (local address 127.0.0.1:34354)
0806 10:41:28.465860 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:28.465875 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:28.465994 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:28.466469 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:28.466473 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:28.466483 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0806 10:41:28.466710 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:28.466718 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:28.468190 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:28.468195 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:28.469401 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:28.469416 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:28.470486 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:28.470491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:28.470636 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:28.470672 (+ 36us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 10:41:28.554668 (+ 83996us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 10:41:28.554928 (+ 260us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.16.45.126:42439: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":368,"threads_started":1}
I20260806 10:41:28.556989 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 25040
I20260806 10:41:28.558211 25133 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:28.659669 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 25040
2026-08-06T10:41:28Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (803 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (416 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (419 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:41:29 dist-test-slave-fgb3 krb5kdc[25222](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:41:29 dist-test-slave-fgb3 krb5kdc[25222](info): set up 2 sockets
Aug 06 10:41:29 dist-test-slave-fgb3 krb5kdc[25222](info): commencing operation
krb5kdc: starting...
W20260806 10:41:30.682078 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.003s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:41:30 dist-test-slave-fgb3 krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:41:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:41:30.919667 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:34353
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:40687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:34353
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:31.245667 25238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:31.245966 25238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:31.246085 25238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:31.253363 25238 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:31.253473 25238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:31.253532 25238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:31.253612 25238 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:31.253670 25238 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:31.263659 25238 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:40687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:34353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:34353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:31.264986 25238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:31.266271 25238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:31.277803 25244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:31.277793 25248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:31.277853 25251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:31.278635 25238 server_base.cc:1034] running on GCE node
I20260806 10:41:31.279453 25238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:31.280844 25238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:31.282071 25238 hybrid_clock.cc:648] HybridClock initialized: now 1786012891282024 us; error 30 us; skew 500 ppm
I20260806 10:41:31.282490 25238 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:31 dist-test-slave-fgb3 krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012891, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:31.285571 25238 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:41:31.287106 25238 webserver.cc:460] Webserver started at http://127.16.45.126:43245/ using document root <none> and password file <none>
I20260806 10:41:31.287789 25238 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:31.287909 25238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:31.288229 25238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:31.291276 25238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "9b76d91233f648d8ac57619044c25b99"
format_stamp: "Formatted at 2026-08-06 10:41:31 on dist-test-slave-fgb3"
server_key: "7acc25df3eaaa009a664b8b116b1db92"
server_key_iv: "34bb9162ac398298d4306f8456eb23a6"
server_key_version: "encryptionkey@0"
I20260806 10:41:31.292064 25238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "9b76d91233f648d8ac57619044c25b99"
format_stamp: "Formatted at 2026-08-06 10:41:31 on dist-test-slave-fgb3"
server_key: "7acc25df3eaaa009a664b8b116b1db92"
server_key_iv: "34bb9162ac398298d4306f8456eb23a6"
server_key_version: "encryptionkey@0"
I20260806 10:41:31.297199 25238 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:41:31.300738 25263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:31.302114 25238 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260806 10:41:31.302273 25238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "9b76d91233f648d8ac57619044c25b99"
format_stamp: "Formatted at 2026-08-06 10:41:31 on dist-test-slave-fgb3"
server_key: "7acc25df3eaaa009a664b8b116b1db92"
server_key_iv: "34bb9162ac398298d4306f8456eb23a6"
server_key_version: "encryptionkey@0"
I20260806 10:41:31.302511 25238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:31.331467 25238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:31.335944 25238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:31.336225 25238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:31.354530 25238 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:34353
I20260806 10:41:31.354564 25336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:34353 every 8 connection(s)
I20260806 10:41:31.355902 25238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:31.359622 25337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:31.362239 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 25238
I20260806 10:41:31.362480 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:31.363281 16565 external_mini_cluster.cc:1428] Setting key 50e60ff514808a238c4e929b3c9bf1b8
I20260806 10:41:31.371973 25337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99: Bootstrap starting.
I20260806 10:41:31.375701 25337 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:31.377010 25337 log.cc:824] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99: Log is configured to *not* fsync() on all Append() calls
Aug 06 10:41:31 dist-test-slave-fgb3 krb5kdc[25222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:31.380100 25337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99: No bootstrap required, opened a new log
I20260806 10:41:31.386214 25340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:31.365460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49498 (local address 127.16.45.126:34353)
0806 10:41:31.366236 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:31.366247 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:31.366290 (+ 43us) server_negotiation.cc:407] Connection header received
0806 10:41:31.368022 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:31.368043 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:31.368465 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:31.368805 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:31.370542 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:31.371832 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:31.373456 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:31.374122 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:31.374242 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:31.379014 (+ 4772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:31.379022 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:31.379036 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:31.379070 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:31.382009 (+ 2939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:31.382821 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:31.382827 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:31.382833 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:31.383006 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:31.383393 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:31.383397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:31.383399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:31.383923 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:31.384140 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:31.384691 (+ 551us) server_negotiation.cc:299] Negotiation successful
0806 10:41:31.385144 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":356,"threads_started":1}
I20260806 10:41:31.388899 25337 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b76d91233f648d8ac57619044c25b99" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34353 } }
I20260806 10:41:31.389341 25337 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:31.389448 25337 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b76d91233f648d8ac57619044c25b99, State: Initialized, Role: FOLLOWER
I20260806 10:41:31.389989 25337 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b76d91233f648d8ac57619044c25b99" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34353 } }
I20260806 10:41:31.390204 25337 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:31.390347 25337 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:31.390503 25337 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:31.392818 25337 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b76d91233f648d8ac57619044c25b99" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34353 } }
I20260806 10:41:31.393296 25337 leader_election.cc:302] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b76d91233f648d8ac57619044c25b99; no voters:
I20260806 10:41:31.393851 25337 leader_election.cc:288] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:31.393997 25344 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:31.395352 25344 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [term 1 LEADER]: Becoming Leader. State: Replica: 9b76d91233f648d8ac57619044c25b99, State: Running, Role: LEADER
I20260806 10:41:31.395928 25344 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b76d91233f648d8ac57619044c25b99" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34353 } }
I20260806 10:41:31.396032 25337 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:31.399047 25346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b76d91233f648d8ac57619044c25b99. Latest consensus state: current_term: 1 leader_uuid: "9b76d91233f648d8ac57619044c25b99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b76d91233f648d8ac57619044c25b99" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34353 } } }
I20260806 10:41:31.399073 25345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b76d91233f648d8ac57619044c25b99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b76d91233f648d8ac57619044c25b99" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34353 } } }
I20260806 10:41:31.399554 25346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:31.399572 25345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:31.401165 25355 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:31.415817 25355 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:31.427284 25355 catalog_manager.cc:1347] Generated new cluster ID: 06844d8ef1a3485b800e7db5c0c6869a
I20260806 10:41:31.427416 25355 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:31.469726 25355 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:31.471719 25355 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:31.490429 25355 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b76d91233f648d8ac57619044c25b99: Generated new TSK 0
I20260806 10:41:31.491510 25355 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:41:31.562121 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34353
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:40687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:31.883227 25379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:31.883553 25379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:31.883692 25379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:31.891005 25379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:31.891132 25379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:31.891280 25379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:41:31.901216 25379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:40687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:31.902586 25379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:31.903929 25379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:31.916643 25386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:31.916659 25388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:31.916801 25385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:31.917527 25379 server_base.cc:1034] running on GCE node
I20260806 10:41:31.918121 25379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:31.919044 25379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:31.920241 25379 hybrid_clock.cc:648] HybridClock initialized: now 1786012891920177 us; error 58 us; skew 500 ppm
I20260806 10:41:31.920532 25379 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:31 dist-test-slave-fgb3 krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012891, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:31.927780 25379 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:41:31.929214 25379 webserver.cc:460] Webserver started at http://127.16.45.65:33361/ using document root <none> and password file <none>
I20260806 10:41:31.929880 25379 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:31.930002 25379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:31.930296 25379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:31.933171 25379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "8d4903e304924988b28d4cca1e91ac92"
format_stamp: "Formatted at 2026-08-06 10:41:31 on dist-test-slave-fgb3"
server_key: "71b511daf809ae1226e8cf5a6ab52f73"
server_key_iv: "7d9100247bf63b611f22c563cbf5b515"
server_key_version: "encryptionkey@0"
I20260806 10:41:31.933914 25379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "8d4903e304924988b28d4cca1e91ac92"
format_stamp: "Formatted at 2026-08-06 10:41:31 on dist-test-slave-fgb3"
server_key: "71b511daf809ae1226e8cf5a6ab52f73"
server_key_iv: "7d9100247bf63b611f22c563cbf5b515"
server_key_version: "encryptionkey@0"
I20260806 10:41:31.938925 25379 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 10:41:31.942205 25402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:31.943461 25379 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:41:31.943610 25379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "8d4903e304924988b28d4cca1e91ac92"
format_stamp: "Formatted at 2026-08-06 10:41:31 on dist-test-slave-fgb3"
server_key: "71b511daf809ae1226e8cf5a6ab52f73"
server_key_iv: "7d9100247bf63b611f22c563cbf5b515"
server_key_version: "encryptionkey@0"
I20260806 10:41:31.943789 25379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:31.956337 25379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:31.960480 25379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:31.960755 25379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:31.961712 25379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:31.963078 25379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:31.963151 25379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:31.963264 25379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:31.963321 25379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:31.994872 25379 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:45411
I20260806 10:41:31.994951 25566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:45411 every 8 connection(s)
I20260806 10:41:31.996145 25379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:41:32.006134 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 25379
I20260806 10:41:32.006374 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:41:32.007134 16565 external_mini_cluster.cc:1428] Setting key 5b9f3bf0d22384380cc2e570409f0559
Aug 06 10:41:32 dist-test-slave-fgb3 krb5kdc[25222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012891, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:32.016449 25570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:31.998816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:33743 (local address 127.16.45.126:34353)
0806 10:41:31.999279 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:31.999284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:32.000128 (+ 844us) server_negotiation.cc:407] Connection header received
0806 10:41:32.001919 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:32.001925 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:32.002016 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:32.002112 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:32.003640 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:32.004422 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:32.006112 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:32.006639 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:32.006741 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:32.010826 (+ 4085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:32.010832 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:32.010835 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:32.010882 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:32.013425 (+ 2543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:32.014210 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:32.014214 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:32.014216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:32.014369 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:32.014805 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:32.014808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:32.014810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:32.015071 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:32.015180 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:32.016007 (+ 827us) server_negotiation.cc:299] Negotiation successful
0806 10:41:32.016179 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":223,"threads_started":1}
I20260806 10:41:32.017779 25573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:31.999204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34353 (local address 127.16.45.65:33743)
0806 10:41:31.999965 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:32.000008 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:32.001665 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:32.002383 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:32.002396 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:32.002905 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:32.003472 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:32.003490 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:32.004568 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:32.004572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:32.005948 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:32.005966 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:32.006890 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:32.006899 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:32.007201 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:32.007918 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:32.007941 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:32.010603 (+ 2662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:32.013565 (+ 2962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:32.013573 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:32.013591 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:32.014114 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:32.014466 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:32.014470 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:32.014473 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:32.014717 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:32.015184 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:32.015191 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:32.015636 (+ 445us) client_negotiation.cc:769] Sending connection context
0806 10:41:32.015924 (+ 288us) client_negotiation.cc:240] Negotiation successful
0806 10:41:32.016464 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":296,"threads_started":1}
I20260806 10:41:32.019272 25568 heartbeater.cc:347] Connected to a master server at 127.16.45.126:34353
I20260806 10:41:32.019574 25568 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:32.020259 25568 heartbeater.cc:511] Master 127.16.45.126:34353 requested a full tablet report, sending...
I20260806 10:41:32.022274 25289 ts_manager.cc:194] Registered new tserver with Master: 8d4903e304924988b28d4cca1e91ac92 (127.16.45.65:45411)
I20260806 10:41:32.023733 25289 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:33743
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:41:32.059820 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34353
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:40687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:32.387048 25578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:32.387339 25578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:32.387442 25578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:32.394809 25578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:32.394927 25578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:32.395080 25578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:41:32.405131 25578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:40687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:32.406554 25578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:32.407941 25578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:32.420691 25590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:32.420714 25588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:32.420940 25594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:32.421504 25578 server_base.cc:1034] running on GCE node
I20260806 10:41:32.422111 25578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:32.423224 25578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:32.424439 25578 hybrid_clock.cc:648] HybridClock initialized: now 1786012892424385 us; error 54 us; skew 500 ppm
I20260806 10:41:32.424736 25578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:32 dist-test-slave-fgb3 krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012892, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:32.427961 25578 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:41:32.429445 25578 webserver.cc:460] Webserver started at http://127.16.45.66:32957/ using document root <none> and password file <none>
I20260806 10:41:32.430127 25578 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:32.430246 25578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:32.430588 25578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:32.433498 25578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "228348c4063842398e3e0d90a1cefa30"
format_stamp: "Formatted at 2026-08-06 10:41:32 on dist-test-slave-fgb3"
server_key: "907891c93726b991c9f25dbbf7a16602"
server_key_iv: "74d2f48cc83d216d0100e8ee8fb92b7e"
server_key_version: "encryptionkey@0"
I20260806 10:41:32.434267 25578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "228348c4063842398e3e0d90a1cefa30"
format_stamp: "Formatted at 2026-08-06 10:41:32 on dist-test-slave-fgb3"
server_key: "907891c93726b991c9f25dbbf7a16602"
server_key_iv: "74d2f48cc83d216d0100e8ee8fb92b7e"
server_key_version: "encryptionkey@0"
I20260806 10:41:32.439536 25578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 10:41:32.443130 25602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:32.444450 25578 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:41:32.444610 25578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "228348c4063842398e3e0d90a1cefa30"
format_stamp: "Formatted at 2026-08-06 10:41:32 on dist-test-slave-fgb3"
server_key: "907891c93726b991c9f25dbbf7a16602"
server_key_iv: "74d2f48cc83d216d0100e8ee8fb92b7e"
server_key_version: "encryptionkey@0"
I20260806 10:41:32.444800 25578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:32.455618 25578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:32.459540 25578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:32.459795 25578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:32.460685 25578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:32.461943 25578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:32.462019 25578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:32.462144 25578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:32.462198 25578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:32.492497 25578 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:46773
I20260806 10:41:32.492535 25771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:46773 every 8 connection(s)
I20260806 10:41:32.493758 25578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:41:32.503333 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 25578
I20260806 10:41:32.503491 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:41:32.503952 16565 external_mini_cluster.cc:1428] Setting key ba52bbe31d0c93bbe3d87791dd8b4c28
Aug 06 10:41:32 dist-test-slave-fgb3 krb5kdc[25222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012892, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:32.514561 25570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:32.496292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:50023 (local address 127.16.45.126:34353)
0806 10:41:32.496455 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:32.496459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:32.497746 (+ 1287us) server_negotiation.cc:407] Connection header received
0806 10:41:32.499876 (+ 2130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:32.499882 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:32.499990 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:32.500081 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:32.501715 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:32.502502 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:32.504198 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:32.504734 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:32.504891 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:32.509035 (+ 4144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:32.509041 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:32.509044 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:32.509077 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:32.511528 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:32.512380 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:32.512384 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:32.512386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:32.512517 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:32.512956 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:32.512959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:32.512961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:32.513201 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:32.513304 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:32.514092 (+ 788us) server_negotiation.cc:299] Negotiation successful
0806 10:41:32.514272 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 10:41:32.515813 25774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:32.496791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34353 (local address 127.16.45.66:50023)
0806 10:41:32.497549 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:32.497595 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:32.499578 (+ 1983us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:32.500387 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:32.500395 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:32.500947 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:32.501529 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:32.501548 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:32.502640 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:32.502644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:32.504027 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:32.504050 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:32.504976 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:32.504982 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:32.505267 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:32.506032 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:32.506063 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:32.508784 (+ 2721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:32.511664 (+ 2880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:32.511674 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:32.511692 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:32.512259 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:32.512618 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:32.512623 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:32.512626 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:32.512867 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:32.513309 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:32.513316 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:32.513728 (+ 412us) client_negotiation.cc:769] Sending connection context
0806 10:41:32.514032 (+ 304us) client_negotiation.cc:240] Negotiation successful
0806 10:41:32.514585 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":327,"threads_started":1}
I20260806 10:41:32.517289 25772 heartbeater.cc:347] Connected to a master server at 127.16.45.126:34353
I20260806 10:41:32.517594 25772 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:32.518350 25772 heartbeater.cc:511] Master 127.16.45.126:34353 requested a full tablet report, sending...
I20260806 10:41:32.519906 25289 ts_manager.cc:194] Registered new tserver with Master: 228348c4063842398e3e0d90a1cefa30 (127.16.45.66:46773)
I20260806 10:41:32.520928 25289 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:50023
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:41:32.555763 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34353
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:40687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:32.881539 25780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:32.881816 25780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:32.881940 25780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:32.889168 25780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:32.889271 25780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:32.889415 25780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:41:32.899032 25780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:40687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:32.900314 25780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:32.901605 25780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:32.914168 25786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:32.914247 25793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:32.914208 25790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:32.915469 25780 server_base.cc:1034] running on GCE node
I20260806 10:41:32.916019 25780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:32.916923 25780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:32.918147 25780 hybrid_clock.cc:648] HybridClock initialized: now 1786012892918098 us; error 36 us; skew 500 ppm
I20260806 10:41:32.918519 25780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:32 dist-test-slave-fgb3 krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012892, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:32.921454 25780 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:41:32.922814 25780 webserver.cc:460] Webserver started at http://127.16.45.67:40555/ using document root <none> and password file <none>
I20260806 10:41:32.923461 25780 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:32.923560 25780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:32.923806 25780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:32.926615 25780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "2dbb4754b887462293ffa87b7f89d3da"
format_stamp: "Formatted at 2026-08-06 10:41:32 on dist-test-slave-fgb3"
server_key: "a79e1a11f171171be58cc6a77a167a0b"
server_key_iv: "e9ae5bb5423286195b3adbc8697aabe1"
server_key_version: "encryptionkey@0"
I20260806 10:41:32.927330 25780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "2dbb4754b887462293ffa87b7f89d3da"
format_stamp: "Formatted at 2026-08-06 10:41:32 on dist-test-slave-fgb3"
server_key: "a79e1a11f171171be58cc6a77a167a0b"
server_key_iv: "e9ae5bb5423286195b3adbc8697aabe1"
server_key_version: "encryptionkey@0"
I20260806 10:41:32.932111 25780 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 10:41:32.935361 25808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:32.936625 25780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:32.936767 25780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "2dbb4754b887462293ffa87b7f89d3da"
format_stamp: "Formatted at 2026-08-06 10:41:32 on dist-test-slave-fgb3"
server_key: "a79e1a11f171171be58cc6a77a167a0b"
server_key_iv: "e9ae5bb5423286195b3adbc8697aabe1"
server_key_version: "encryptionkey@0"
I20260806 10:41:32.936941 25780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:32.971616 25780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:32.975739 25780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:32.976004 25780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:32.976965 25780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:32.978384 25780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:32.978466 25780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:32.978590 25780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:32.978639 25780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:33.012610 25780 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:33309
I20260806 10:41:33.012651 25960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:33309 every 8 connection(s)
I20260806 10:41:33.013902 25780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:41:33.019454 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 25780
I20260806 10:41:33.019639 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:41:33.020179 16565 external_mini_cluster.cc:1428] Setting key 8db4303bdb5b3d31cfa6ec8d503c5021
I20260806 10:41:33.026693 25568 heartbeater.cc:503] Master 127.16.45.126:34353 was elected leader, sending a full tablet report...
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012892, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:33.035007 25964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:33.016771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:41113 (local address 127.16.45.126:34353)
0806 10:41:33.017268 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:33.017274 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:33.018169 (+ 895us) server_negotiation.cc:407] Connection header received
0806 10:41:33.020550 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:33.020556 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:33.020636 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:33.020780 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:33.022447 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.023300 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.024853 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.025259 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.025371 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:33.029208 (+ 3837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:33.029214 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:33.029217 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:33.029258 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:33.031773 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.032525 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.032529 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.032531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.032670 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.033099 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.033103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.033106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.033413 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:33.033545 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:33.034396 (+ 851us) server_negotiation.cc:299] Negotiation successful
0806 10:41:33.034643 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":242,"threads_started":1}
I20260806 10:41:33.036093 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:33.017200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34353 (local address 127.16.45.67:41113)
0806 10:41:33.017954 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:33.018027 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:33.020193 (+ 2166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:33.020983 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:33.020991 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:33.021511 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:33.022236 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:33.022257 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.023453 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.023457 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:33.024711 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:33.024723 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.025490 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.025498 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:33.025717 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:33.026421 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:33.026476 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:33.029011 (+ 2535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:33.031927 (+ 2916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:33.031934 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:33.031948 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:33.032386 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:33.032757 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:33.032760 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:33.032762 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:33.032965 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:33.033530 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:33.033536 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:33.033978 (+ 442us) client_negotiation.cc:769] Sending connection context
0806 10:41:33.034252 (+ 274us) client_negotiation.cc:240] Negotiation successful
0806 10:41:33.034789 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":322,"threads_started":1}
I20260806 10:41:33.037462 25961 heartbeater.cc:347] Connected to a master server at 127.16.45.126:34353
I20260806 10:41:33.037750 25961 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:33.038544 25961 heartbeater.cc:511] Master 127.16.45.126:34353 requested a full tablet report, sending...
I20260806 10:41:33.039961 25289 ts_manager.cc:194] Registered new tserver with Master: 2dbb4754b887462293ffa87b7f89d3da (127.16.45.67:33309)
I20260806 10:41:33.040872 25289 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:41113
I20260806 10:41:33.048774 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/test-admin.keytab.
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:33.079975 16565 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 10:41:33.085285 25972 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:41:33.082676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43534 (local address 127.16.45.65:45411)
0806 10:41:33.083269 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:33.083278 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:33.083311 (+ 33us) server_negotiation.cc:407] Connection header received
0806 10:41:33.083482 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:33.083490 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:33.083692 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:33.083849 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:33.084842 (+ 993us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43534: BlockingRecv error: recv got EOF from 127.0.0.1:43534 (error 108)
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":261,"threads_started":1}
W20260806 10:41:33.085356 16565 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/krb5cc' of type FILE
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:33.086944 16565 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:33.088275 16565 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:41:33.103523 25972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:33.089935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43546 (local address 127.16.45.65:45411)
0806 10:41:33.090122 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:33.090128 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:33.090252 (+ 124us) server_negotiation.cc:407] Connection header received
0806 10:41:33.090461 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:33.090466 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:33.090527 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:33.090611 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:33.091602 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.092612 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.093792 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.094436 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.094535 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:33.098127 (+ 3592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:33.098139 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:33.098154 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:33.098194 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:33.100987 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.101568 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.101576 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.101578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.101695 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.101998 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.102001 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.102003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.102403 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:33.102620 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:33.102956 (+ 336us) server_negotiation.cc:299] Negotiation successful
0806 10:41:33.103251 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260806 10:41:33.109427 25972 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:41:33.107480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43558 (local address 127.16.45.65:45411)
0806 10:41:33.107635 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:33.107639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:33.108025 (+ 386us) server_negotiation.cc:407] Connection header received
0806 10:41:33.108147 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:33.108151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:33.108273 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:33.108380 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:33.109137 (+ 757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43558: BlockingRecv error: recv got EOF from 127.0.0.1:43558 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 10:41:33.109633 16565 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/krb5cc' of type FILE
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:33.111277 16565 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:33.112509 16565 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:41:33.127352 25972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:33.113783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43560 (local address 127.16.45.65:45411)
0806 10:41:33.113983 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:33.113988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:33.114169 (+ 181us) server_negotiation.cc:407] Connection header received
0806 10:41:33.114377 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:33.114383 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:33.114448 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:33.114528 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:33.115496 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.116220 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.117432 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.117839 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.117949 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:33.121874 (+ 3925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:33.121881 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:33.121885 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:33.121930 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:33.124833 (+ 2903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.125475 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.125480 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.125482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.125621 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.125939 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.125942 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.125944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.126239 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:33.126521 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:33.126824 (+ 303us) server_negotiation.cc:299] Negotiation successful
0806 10:41:33.126999 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260806 10:41:33.131610 25972 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:41:33.130005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43562 (local address 127.16.45.65:45411)
0806 10:41:33.130212 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:33.130218 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:33.130371 (+ 153us) server_negotiation.cc:407] Connection header received
0806 10:41:33.130493 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:33.130497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:33.130563 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:33.130649 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:33.131409 (+ 760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43562: BlockingRecv error: recv got EOF from 127.0.0.1:43562 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260806 10:41:33.132175 16565 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786012840862403-16565-0/krb5kdc/krb5cc)
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:33.133677 16565 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:33.135010 16565 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:41:33.149191 25972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:33.136225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43566 (local address 127.16.45.65:45411)
0806 10:41:33.136452 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:33.136458 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:33.136710 (+ 252us) server_negotiation.cc:407] Connection header received
0806 10:41:33.136876 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:33.136881 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:33.136942 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:33.137018 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:33.137923 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.138712 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.139919 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.140407 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.140524 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:33.143724 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:33.143730 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:33.143733 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:33.143762 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:33.146352 (+ 2590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.147091 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.147097 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.147102 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.147254 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.147623 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.147629 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.147633 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.148014 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:33.148341 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:33.148630 (+ 289us) server_negotiation.cc:299] Negotiation successful
0806 10:41:33.148847 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 10:41:33.150791 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 25379
I20260806 10:41:33.162600 25972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:33.151490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43572 (local address 127.16.45.65:45411)
0806 10:41:33.151645 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:33.151651 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:33.151952 (+ 301us) server_negotiation.cc:407] Connection header received
0806 10:41:33.152127 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:33.152133 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:33.152196 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:33.152275 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:33.153251 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.153933 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.155234 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.155693 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.155829 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:33.157909 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:33.157914 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:33.157917 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:33.157946 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:33.160265 (+ 2319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.160848 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.160853 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.160857 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.160982 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.161339 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.161344 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.161346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.161581 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:33.161824 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:33.162109 (+ 285us) server_negotiation.cc:299] Negotiation successful
0806 10:41:33.162302 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 10:41:33.163110 25559 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:33.245035 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 25379
I20260806 10:41:33.266059 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 25578
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:41:33.281244 25993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:33.267017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58384 (local address 127.16.45.66:46773)
0806 10:41:33.267554 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:33.267561 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:33.267588 (+ 27us) server_negotiation.cc:407] Connection header received
0806 10:41:33.267645 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:33.267651 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:33.267845 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:33.267984 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:33.268983 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.270000 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.271359 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.271890 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.272014 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:33.275719 (+ 3705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:33.275730 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:33.275743 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:33.275775 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:33.278637 (+ 2862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.279252 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.279259 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.279262 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.279391 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.279727 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.279731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.279733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.280065 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:33.280370 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:33.280696 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 10:41:33.280949 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":265,"threads_started":1}
I20260806 10:41:33.282510 25766 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:33.366811 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 25578
I20260806 10:41:33.384636 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 25780
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[25222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:41:33.400687 25995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:33.385713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36400 (local address 127.16.45.67:33309)
0806 10:41:33.386444 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:33.386450 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:33.386480 (+ 30us) server_negotiation.cc:407] Connection header received
0806 10:41:33.386546 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:33.386553 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:33.386757 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:33.386922 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:33.388061 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.389088 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.390367 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:33.390938 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:33.391054 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:33.395099 (+ 4045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:33.395113 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:33.395128 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:33.395164 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:33.398100 (+ 2936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.398882 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.398890 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.398892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.399021 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:33.399345 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:33.399348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:33.399350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:33.399708 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:33.400001 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:33.400187 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 10:41:33.400396 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":354,"threads_started":1}
I20260806 10:41:33.402058 25955 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:33.483385 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 25780
I20260806 10:41:33.504185 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 25238
I20260806 10:41:33.505465 25329 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:33.608575 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 25238
2026-08-06T10:41:33Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4115 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[26005](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[26005](info): set up 2 sockets
Aug 06 10:41:33 dist-test-slave-fgb3 krb5kdc[26005](info): commencing operation
krb5kdc: starting...
W20260806 10:41:34.782821 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:41:34 dist-test-slave-fgb3 krb5kdc[26005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:41:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:34Z Disabled control of system clock
WARNING: no policy specified for oryx/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.126.keytab.
Entry for principal oryx/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.126.keytab.
I20260806 10:41:35.019981 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:34899
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.126.keytab
--principal=oryx/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:36767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:34899
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:35.349773 26023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:35.350063 26023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:35.350154 26023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:35.357458 26023 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:35.357584 26023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:35.357630 26023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:35.357686 26023 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:35.357728 26023 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:35.367812 26023 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:34899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.126.keytab
--principal=oryx/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:34899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:35.369150 26023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:35.370461 26023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:35.382020 26029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:35.381956 26030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:35.381999 26035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:35.382956 26023 server_base.cc:1034] running on GCE node
I20260806 10:41:35.383811 26023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:35.385162 26023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:35.386420 26023 hybrid_clock.cc:648] HybridClock initialized: now 1786012895386355 us; error 50 us; skew 500 ppm
I20260806 10:41:35.386755 26023 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:35 dist-test-slave-fgb3 krb5kdc[26005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012895, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:35.389820 26023 init.cc:377] Logged in from keytab as oryx/127.16.45.126@KRBTEST.COM (short username oryx)
I20260806 10:41:35.391320 26023 webserver.cc:460] Webserver started at http://127.16.45.126:37989/ using document root <none> and password file <none>
I20260806 10:41:35.391997 26023 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:35.392118 26023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:35.392452 26023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:35.395462 26023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "fdde3c17390c427e9af52c8cbc0f512b"
format_stamp: "Formatted at 2026-08-06 10:41:35 on dist-test-slave-fgb3"
server_key: "05479a8efe167ed5ef1166a367b62a2a"
server_key_iv: "c3821557a05cb489a29b22e50c9d75aa"
server_key_version: "encryptionkey@0"
I20260806 10:41:35.396181 26023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "fdde3c17390c427e9af52c8cbc0f512b"
format_stamp: "Formatted at 2026-08-06 10:41:35 on dist-test-slave-fgb3"
server_key: "05479a8efe167ed5ef1166a367b62a2a"
server_key_iv: "c3821557a05cb489a29b22e50c9d75aa"
server_key_version: "encryptionkey@0"
I20260806 10:41:35.401304 26023 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:41:35.404774 26044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:35.406175 26023 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 10:41:35.406430 26023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "fdde3c17390c427e9af52c8cbc0f512b"
format_stamp: "Formatted at 2026-08-06 10:41:35 on dist-test-slave-fgb3"
server_key: "05479a8efe167ed5ef1166a367b62a2a"
server_key_iv: "c3821557a05cb489a29b22e50c9d75aa"
server_key_version: "encryptionkey@0"
I20260806 10:41:35.406622 26023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:35.437361 26023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:35.441645 26023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:35.441931 26023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:35.461081 26114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:34899 every 8 connection(s)
I20260806 10:41:35.461090 26023 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:34899
I20260806 10:41:35.463093 26023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:35.463900 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 26023
I20260806 10:41:35.464197 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:35.465042 16565 external_mini_cluster.cc:1428] Setting key 2f6db0a4d43c54ffc53b4c894d9c0000
I20260806 10:41:35.468238 26115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:35.485628 26115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b: Bootstrap starting.
Aug 06 10:41:35 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
I20260806 10:41:35.489079 26115 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:35.490482 26115 log.cc:824] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:35.493655 26115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b: No bootstrap required, opened a new log
I20260806 10:41:35.497090 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:35.467306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54308 (local address 127.16.45.126:34899)
0806 10:41:35.475787 (+ 8481us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:35.475804 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:35.475870 (+ 66us) server_negotiation.cc:407] Connection header received
0806 10:41:35.477614 (+ 1744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:35.477660 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:35.478284 (+ 624us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:35.478935 (+ 651us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:35.480310 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:35.482302 (+ 1992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:35.483609 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:35.484659 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:35.484854 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:35.488897 (+ 4043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:35.488909 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:35.488929 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:35.488982 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:35.492637 (+ 3655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:35.493335 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:35.493342 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:35.493356 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:35.493519 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:35.493938 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:35.493942 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:35.493944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:35.494562 (+ 618us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:35.494879 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:35.495475 (+ 596us) server_negotiation.cc:299] Negotiation successful
0806 10:41:35.495995 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8204,"thread_start_us":7978,"threads_started":1}
I20260806 10:41:35.502252 26115 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } }
I20260806 10:41:35.502713 26115 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:35.502818 26115 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdde3c17390c427e9af52c8cbc0f512b, State: Initialized, Role: FOLLOWER
I20260806 10:41:35.503355 26115 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } }
I20260806 10:41:35.503638 26115 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:35.503784 26115 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:35.503980 26115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:35.506356 26115 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } }
I20260806 10:41:35.506932 26115 leader_election.cc:302] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdde3c17390c427e9af52c8cbc0f512b; no voters:
I20260806 10:41:35.507583 26115 leader_election.cc:288] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:35.507769 26126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:35.508922 26126 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 1 LEADER]: Becoming Leader. State: Replica: fdde3c17390c427e9af52c8cbc0f512b, State: Running, Role: LEADER
I20260806 10:41:35.509426 26126 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } }
I20260806 10:41:35.509819 26115 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:35.512368 26127 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } }
I20260806 10:41:35.512694 26127 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:35.512480 26128 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdde3c17390c427e9af52c8cbc0f512b. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } }
I20260806 10:41:35.512810 26128 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:35.513731 26136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:35.521298 26136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:35.530057 26136 catalog_manager.cc:1347] Generated new cluster ID: 80b420ac56fe4c57bfde83b973b27a4a
I20260806 10:41:35.530184 26136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:35.568975 26136 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:35.570261 26136 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:35.578759 26136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b: Generated new TSK 0
I20260806 10:41:35.579782 26136 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab.
Entry for principal oryx/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab.
I20260806 10:41:35.641839 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34899
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab
--principal=oryx/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:36767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:35.980185 26154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:35.980482 26154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:35.980592 26154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:35.987883 26154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:35.987993 26154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:35.988118 26154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:41:35.997632 26154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab
--principal=oryx/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:35.999060 26154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:36.000408 26154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:36.013480 26167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:36.013674 26165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:36.013962 26160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:36.014218 26154 server_base.cc:1034] running on GCE node
I20260806 10:41:36.014798 26154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:36.015707 26154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:36.016939 26154 hybrid_clock.cc:648] HybridClock initialized: now 1786012896016894 us; error 38 us; skew 500 ppm
I20260806 10:41:36.017256 26154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:36 dist-test-slave-fgb3 krb5kdc[26005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012896, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:36.020494 26154 init.cc:377] Logged in from keytab as oryx/127.16.45.65@KRBTEST.COM (short username oryx)
I20260806 10:41:36.021962 26154 webserver.cc:460] Webserver started at http://127.16.45.65:36351/ using document root <none> and password file <none>
I20260806 10:41:36.022699 26154 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:36.022821 26154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:36.023139 26154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:36.026146 26154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "63364df350a640d0864f873f77a07209"
format_stamp: "Formatted at 2026-08-06 10:41:36 on dist-test-slave-fgb3"
server_key: "32c7a1c13f48bdcc8dbcb85baeb0b00b"
server_key_iv: "3185dfafca1ef3ae5479525e6aea8587"
server_key_version: "encryptionkey@0"
I20260806 10:41:36.026993 26154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "63364df350a640d0864f873f77a07209"
format_stamp: "Formatted at 2026-08-06 10:41:36 on dist-test-slave-fgb3"
server_key: "32c7a1c13f48bdcc8dbcb85baeb0b00b"
server_key_iv: "3185dfafca1ef3ae5479525e6aea8587"
server_key_version: "encryptionkey@0"
I20260806 10:41:36.032145 26154 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 10:41:36.035655 26179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:36.036989 26154 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:41:36.037145 26154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "63364df350a640d0864f873f77a07209"
format_stamp: "Formatted at 2026-08-06 10:41:36 on dist-test-slave-fgb3"
server_key: "32c7a1c13f48bdcc8dbcb85baeb0b00b"
server_key_iv: "3185dfafca1ef3ae5479525e6aea8587"
server_key_version: "encryptionkey@0"
I20260806 10:41:36.037335 26154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:36.050186 26154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:36.054347 26154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:36.054627 26154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:36.055593 26154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:36.056967 26154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:36.057046 26154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:36.057168 26154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:36.057221 26154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:36.087833 26154 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:34031
I20260806 10:41:36.087885 26340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:34031 every 8 connection(s)
I20260806 10:41:36.089076 26154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:41:36.095484 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 26154
I20260806 10:41:36.095672 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:41:36.096305 16565 external_mini_cluster.cc:1428] Setting key 18ed8beb156297e6a7969271849a9a21
Aug 06 10:41:36 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012896, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
I20260806 10:41:36.109546 26344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:36.091459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:43233 (local address 127.16.45.126:34899)
0806 10:41:36.091893 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:36.091897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:36.092758 (+ 861us) server_negotiation.cc:407] Connection header received
0806 10:41:36.094571 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:36.094578 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:36.094655 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:36.094750 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:36.096255 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:36.097072 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:36.099104 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:36.099671 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:36.099794 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:36.103314 (+ 3520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:36.103320 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:36.103325 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:36.103361 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:36.106275 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:36.107018 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:36.107023 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:36.107026 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:36.107170 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:36.107670 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:36.107673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:36.107675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:36.107937 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:36.108045 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:36.108925 (+ 880us) server_negotiation.cc:299] Negotiation successful
0806 10:41:36.109149 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":226,"threads_started":1}
I20260806 10:41:36.110652 26345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:36.091911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.65:43233)
0806 10:41:36.092602 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:36.092640 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:36.094268 (+ 1628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:36.094986 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:36.094993 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:36.095488 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:36.096089 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:36.096106 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:36.097243 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:36.097247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:36.098946 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:36.098959 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:36.099903 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:36.099908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:36.100100 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:36.100812 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:36.100835 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:36.103091 (+ 2256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:36.106445 (+ 3354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:36.106452 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:36.106464 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:36.106894 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:36.107298 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:36.107311 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:36.107315 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:36.107571 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:36.108051 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:36.108059 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:36.108523 (+ 464us) client_negotiation.cc:769] Sending connection context
0806 10:41:36.108780 (+ 257us) client_negotiation.cc:240] Negotiation successful
0806 10:41:36.109316 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":251,"threads_started":1}
I20260806 10:41:36.112574 26341 heartbeater.cc:347] Connected to a master server at 127.16.45.126:34899
I20260806 10:41:36.112910 26341 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:36.113672 26341 heartbeater.cc:511] Master 127.16.45.126:34899 requested a full tablet report, sending...
I20260806 10:41:36.116127 26068 ts_manager.cc:194] Registered new tserver with Master: 63364df350a640d0864f873f77a07209 (127.16.45.65:34031)
I20260806 10:41:36.117662 26068 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:43233
WARNING: no policy specified for oryx/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab.
Entry for principal oryx/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab.
I20260806 10:41:36.153337 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34899
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab
--principal=oryx/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:36767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:36.488574 26348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:36.488864 26348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:36.488991 26348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:36.496249 26348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:36.496376 26348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:36.496538 26348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:41:36.506654 26348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab
--principal=oryx/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:36.507982 26348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:36.509294 26348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:36.522833 26356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:36.522799 26358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:36.523146 26361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:36.523458 26348 server_base.cc:1034] running on GCE node
I20260806 10:41:36.524140 26348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:36.525152 26348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:36.526422 26348 hybrid_clock.cc:648] HybridClock initialized: now 1786012896526363 us; error 46 us; skew 500 ppm
I20260806 10:41:36.526767 26348 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:36 dist-test-slave-fgb3 krb5kdc[26005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012896, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:36.530018 26348 init.cc:377] Logged in from keytab as oryx/127.16.45.66@KRBTEST.COM (short username oryx)
I20260806 10:41:36.531651 26348 webserver.cc:460] Webserver started at http://127.16.45.66:33069/ using document root <none> and password file <none>
I20260806 10:41:36.532485 26348 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:36.532618 26348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:36.532936 26348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:36.536165 26348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "4399de29d9e74ea3a18f8f563cc4f62e"
format_stamp: "Formatted at 2026-08-06 10:41:36 on dist-test-slave-fgb3"
server_key: "9db1d10c89bbb703cfa3727358d529e9"
server_key_iv: "7a1d4aa37a5c4053f01ae18f5805a60d"
server_key_version: "encryptionkey@0"
I20260806 10:41:36.537052 26348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "4399de29d9e74ea3a18f8f563cc4f62e"
format_stamp: "Formatted at 2026-08-06 10:41:36 on dist-test-slave-fgb3"
server_key: "9db1d10c89bbb703cfa3727358d529e9"
server_key_iv: "7a1d4aa37a5c4053f01ae18f5805a60d"
server_key_version: "encryptionkey@0"
I20260806 10:41:36.542595 26348 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 10:41:36.546120 26368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:36.547629 26348 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:36.547806 26348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "4399de29d9e74ea3a18f8f563cc4f62e"
format_stamp: "Formatted at 2026-08-06 10:41:36 on dist-test-slave-fgb3"
server_key: "9db1d10c89bbb703cfa3727358d529e9"
server_key_iv: "7a1d4aa37a5c4053f01ae18f5805a60d"
server_key_version: "encryptionkey@0"
I20260806 10:41:36.548002 26348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:36.565466 26348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:36.569659 26348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:36.569947 26348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:36.570969 26348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:36.572364 26348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:36.572444 26348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:36.572568 26348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:36.572623 26348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:36.603425 26348 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:38487
I20260806 10:41:36.603461 26546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:38487 every 8 connection(s)
I20260806 10:41:36.604656 26348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:41:36.607825 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 26348
I20260806 10:41:36.608029 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:41:36.608613 16565 external_mini_cluster.cc:1428] Setting key b79bfb26a3919d29e589585972ff03c3
Aug 06 10:41:36 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012896, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
I20260806 10:41:36.624979 26344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:36.607015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:44141 (local address 127.16.45.126:34899)
0806 10:41:36.607173 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:36.607178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:36.608603 (+ 1425us) server_negotiation.cc:407] Connection header received
0806 10:41:36.611119 (+ 2516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:36.611125 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:36.611211 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:36.611302 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:36.612842 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:36.613523 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:36.615074 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:36.615475 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:36.615583 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:36.619090 (+ 3507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:36.619095 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:36.619098 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:36.619129 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:36.621675 (+ 2546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:36.622612 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:36.622616 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:36.622620 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:36.622760 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:36.623311 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:36.623315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:36.623318 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:36.623600 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:36.623723 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:36.624545 (+ 822us) server_negotiation.cc:299] Negotiation successful
0806 10:41:36.624726 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 10:41:36.626511 26551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:36.607511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.66:44141)
0806 10:41:36.608432 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:36.608482 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:36.610862 (+ 2380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:36.611552 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:36.611561 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:36.612040 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:36.612680 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:36.612699 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:36.613678 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:36.613684 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:36.614940 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:36.614952 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:36.615682 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:36.615690 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:36.615910 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:36.616509 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:36.616530 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:36.618863 (+ 2333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:36.621839 (+ 2976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:36.621859 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:36.621876 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:36.622495 (+ 619us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:36.622899 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:36.622905 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:36.622908 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:36.623210 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:36.623725 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:36.623734 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:36.624163 (+ 429us) client_negotiation.cc:769] Sending connection context
0806 10:41:36.624480 (+ 317us) client_negotiation.cc:240] Negotiation successful
0806 10:41:36.625061 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":442,"threads_started":1}
I20260806 10:41:36.627969 26548 heartbeater.cc:347] Connected to a master server at 127.16.45.126:34899
I20260806 10:41:36.628291 26548 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:36.629194 26548 heartbeater.cc:511] Master 127.16.45.126:34899 requested a full tablet report, sending...
I20260806 10:41:36.630885 26068 ts_manager.cc:194] Registered new tserver with Master: 4399de29d9e74ea3a18f8f563cc4f62e (127.16.45.66:38487)
I20260806 10:41:36.632038 26068 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:44141
WARNING: no policy specified for oryx/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab.
Entry for principal oryx/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab.
I20260806 10:41:36.664820 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34899
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab
--principal=oryx/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:36767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:36.989341 26557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:36.989598 26557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:36.989691 26557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:36.996766 26557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:36.996873 26557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:36.996994 26557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:41:37.006536 26557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab
--principal=oryx/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:34899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:37.007763 26557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:37.008998 26557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:37.022212 26563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:37.022261 26564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:37.022295 26568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:37.023152 26557 server_base.cc:1034] running on GCE node
I20260806 10:41:37.023829 26557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:37.024843 26557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:37.026063 26557 hybrid_clock.cc:648] HybridClock initialized: now 1786012897026009 us; error 50 us; skew 500 ppm
I20260806 10:41:37.026510 26557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:37 dist-test-slave-fgb3 krb5kdc[26005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012897, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:37.032454 26557 init.cc:377] Logged in from keytab as oryx/127.16.45.67@KRBTEST.COM (short username oryx)
I20260806 10:41:37.034062 26557 webserver.cc:460] Webserver started at http://127.16.45.67:41751/ using document root <none> and password file <none>
I20260806 10:41:37.034849 26557 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:37.034978 26557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:37.035306 26557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:37.038470 26557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "48df401686594af9a76e6559fa33de78"
format_stamp: "Formatted at 2026-08-06 10:41:37 on dist-test-slave-fgb3"
server_key: "189e6218ff99b95ec3df67277428dce9"
server_key_iv: "7e309f8c86d7841d00b3a21ffc32dd77"
server_key_version: "encryptionkey@0"
I20260806 10:41:37.039351 26557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "48df401686594af9a76e6559fa33de78"
format_stamp: "Formatted at 2026-08-06 10:41:37 on dist-test-slave-fgb3"
server_key: "189e6218ff99b95ec3df67277428dce9"
server_key_iv: "7e309f8c86d7841d00b3a21ffc32dd77"
server_key_version: "encryptionkey@0"
I20260806 10:41:37.044932 26557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260806 10:41:37.048523 26576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:37.050024 26557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:41:37.050211 26557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "48df401686594af9a76e6559fa33de78"
format_stamp: "Formatted at 2026-08-06 10:41:37 on dist-test-slave-fgb3"
server_key: "189e6218ff99b95ec3df67277428dce9"
server_key_iv: "7e309f8c86d7841d00b3a21ffc32dd77"
server_key_version: "encryptionkey@0"
I20260806 10:41:37.050490 26557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:37.075855 26557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:37.080456 26557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:37.080750 26557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:37.081780 26557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:37.083228 26557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:37.083320 26557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:37.083446 26557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:37.083500 26557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:37.114977 26557 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:41305
I20260806 10:41:37.115039 26753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:41305 every 8 connection(s)
I20260806 10:41:37.116214 26557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:41:37.118219 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 26557
I20260806 10:41:37.118404 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:41:37.118901 16565 external_mini_cluster.cc:1428] Setting key 32b44832d5b39374e9f54d0d5e02f6c3
I20260806 10:41:37.120725 26341 heartbeater.cc:503] Master 127.16.45.126:34899 was elected leader, sending a full tablet report...
Aug 06 10:41:37 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012897, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
I20260806 10:41:37.137408 26344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.118868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:49723 (local address 127.16.45.126:34899)
0806 10:41:37.119083 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:37.119089 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:37.120457 (+ 1368us) server_negotiation.cc:407] Connection header received
0806 10:41:37.123247 (+ 2790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:37.123251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:37.123329 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:37.123423 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:37.124796 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.125556 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.127155 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.127607 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.127706 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.130971 (+ 3265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:37.130976 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:37.130980 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:37.131014 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:37.133810 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.134774 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.134779 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.134784 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.134949 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.135479 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.135485 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.135489 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.135859 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:37.136016 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:37.136990 (+ 974us) server_negotiation.cc:299] Negotiation successful
0806 10:41:37.137164 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 10:41:37.138479 26762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.119426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.67:49723)
0806 10:41:37.120281 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:37.120337 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:37.122999 (+ 2662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:37.123593 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:37.123602 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:37.124105 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:37.124663 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.124679 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.125677 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.125680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.127006 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.127018 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.127792 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.127797 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.128000 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.128610 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:37.128632 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:37.130759 (+ 2127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:37.134010 (+ 3251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.134020 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.134036 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.134633 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.135066 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.135071 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.135074 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.135351 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.136095 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:37.136104 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:37.136522 (+ 418us) client_negotiation.cc:769] Sending connection context
0806 10:41:37.136839 (+ 317us) client_negotiation.cc:240] Negotiation successful
0806 10:41:37.137281 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":336,"threads_started":1}
I20260806 10:41:37.139755 26754 heartbeater.cc:347] Connected to a master server at 127.16.45.126:34899
I20260806 10:41:37.140066 26754 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:37.140811 26754 heartbeater.cc:511] Master 127.16.45.126:34899 requested a full tablet report, sending...
I20260806 10:41:37.142361 26066 ts_manager.cc:194] Registered new tserver with Master: 48df401686594af9a76e6559fa33de78 (127.16.45.67:41305)
I20260806 10:41:37.143213 26066 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:49723
I20260806 10:41:37.146345 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.16.45.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.125.keytab.
Entry for principal oryx/127.16.45.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.125.keytab.
I20260806 10:41:37.200084 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.125:40553
--webserver_interface=127.16.45.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.125.keytab
--principal=oryx/127.16.45.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:36767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:34899,127.16.45.125:40553
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:37.533303 26765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:37.533615 26765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:37.533718 26765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:37.541275 26765 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:37.541402 26765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:37.541483 26765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:37.541556 26765 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:37.541601 26765 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:37.551932 26765 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:34899,127.16.45.125:40553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.125.keytab
--principal=oryx/127.16.45.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.125:40553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.16.45.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
W20260806 10:41:37.552304 26765 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.16.45.126:34899,127.16.45.125:40553'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 10:41:37.553385 26765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:37.554785 26765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:37.566857 26772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:37.566780 26773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:37.566846 26775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:37.567539 26765 server_base.cc:1034] running on GCE node
I20260806 10:41:37.568325 26765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:37.569717 26765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:37.570950 26765 hybrid_clock.cc:648] HybridClock initialized: now 1786012897570883 us; error 33 us; skew 500 ppm
I20260806 10:41:37.571290 26765 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:37 dist-test-slave-fgb3 krb5kdc[26005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012897, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:37.574383 26765 init.cc:377] Logged in from keytab as oryx/127.16.45.125@KRBTEST.COM (short username oryx)
I20260806 10:41:37.575798 26765 webserver.cc:460] Webserver started at http://127.16.45.125:41851/ using document root <none> and password file <none>
I20260806 10:41:37.576496 26765 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:37.576599 26765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:37.576895 26765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:37.579878 26765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data/instance:
uuid: "7801bc445429445198295507aa9e724b"
format_stamp: "Formatted at 2026-08-06 10:41:37 on dist-test-slave-fgb3"
server_key: "dd8877f7062707f9c83159886fa7fa32"
server_key_iv: "edf7c90b972f8b45dc8ea603da8ce454"
server_key_version: "encryptionkey@0"
I20260806 10:41:37.580617 26765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/wal/instance:
uuid: "7801bc445429445198295507aa9e724b"
format_stamp: "Formatted at 2026-08-06 10:41:37 on dist-test-slave-fgb3"
server_key: "dd8877f7062707f9c83159886fa7fa32"
server_key_iv: "edf7c90b972f8b45dc8ea603da8ce454"
server_key_version: "encryptionkey@0"
I20260806 10:41:37.585659 26765 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.006s
I20260806 10:41:37.589084 26784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:37.590447 26765 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 10:41:37.590602 26765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/wal
uuid: "7801bc445429445198295507aa9e724b"
format_stamp: "Formatted at 2026-08-06 10:41:37 on dist-test-slave-fgb3"
server_key: "dd8877f7062707f9c83159886fa7fa32"
server_key_iv: "edf7c90b972f8b45dc8ea603da8ce454"
server_key_version: "encryptionkey@0"
I20260806 10:41:37.590801 26765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:37.612028 26765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:37.616235 26765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:37.616488 26765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:37.632941 26765 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.125:40553
I20260806 10:41:37.632943 26860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.125:40553 every 8 connection(s)
I20260806 10:41:37.634433 26765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
I20260806 10:41:37.634917 26548 heartbeater.cc:503] Master 127.16.45.126:34899 was elected leader, sending a full tablet report...
I20260806 10:41:37.636751 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 26765
I20260806 10:41:37.638813 26862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:37.647598 26862 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:41:37 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.45.125@KRBTEST.COM
Aug 06 10:41:37 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012897, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.125@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
I20260806 10:41:37.660038 26866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.639043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58410 (local address 127.16.45.125:40553)
0806 10:41:37.639812 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:37.639824 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:37.639866 (+ 42us) server_negotiation.cc:407] Connection header received
0806 10:41:37.641512 (+ 1646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:37.641535 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:37.641958 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:37.642296 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:37.644246 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.645618 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.647365 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.648081 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.648230 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.653077 (+ 4847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:37.653086 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:37.653096 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:37.653131 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:37.656026 (+ 2895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.656652 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.656658 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.656663 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.656828 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.657198 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.657201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.657203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.657686 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:37.658006 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:37.658449 (+ 443us) server_negotiation.cc:299] Negotiation successful
0806 10:41:37.658842 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":354,"threads_started":1}
I20260806 10:41:37.664657 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.650429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54318)
0806 10:41:37.651144 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:37.651184 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:37.651364 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:37.652097 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:37.652104 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:37.652734 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:37.653092 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.653102 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.654236 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.654242 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.655573 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.655586 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.656293 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.656300 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.656446 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.656975 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:37.656992 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:37.659134 (+ 2142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:37.662201 (+ 3067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.662211 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.662216 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.662816 (+ 600us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.663202 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.663205 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.663207 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.663336 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.663875 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:37.663881 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:37.664023 (+ 142us) client_negotiation.cc:769] Sending connection context
0806 10:41:37.664162 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 10:41:37.664388 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":337,"threads_started":1}
I20260806 10:41:37.664683 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.650521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54318 (local address 127.16.45.126:34899)
0806 10:41:37.651725 (+ 1204us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:37.651731 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:37.651750 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:41:37.651824 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:37.651829 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:37.651905 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:37.651997 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:37.653238 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.654107 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.655704 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.656110 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.656219 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.659356 (+ 3137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:37.659363 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:37.659367 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:37.659409 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:37.662078 (+ 2669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.662957 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.662962 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.662966 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.663111 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.663436 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.663440 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.663442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.663770 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:37.663889 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:37.664274 (+ 385us) server_negotiation.cc:299] Negotiation successful
0806 10:41:37.664451 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1087,"thread_start_us":963,"threads_started":1}
I20260806 10:41:37.666419 26862 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:41:37 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012897, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.125@KRBTEST.COM for oryx/127.16.45.125@KRBTEST.COM
I20260806 10:41:37.677614 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.666954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:40553 (local address 127.0.0.1:58420)
0806 10:41:37.667127 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:37.667142 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:37.667221 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:37.667505 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:37.667508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:37.667815 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:37.667943 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.667951 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.668892 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.668895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.669763 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.669774 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.670457 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.670461 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.670599 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.671056 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:37.671071 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:37.672918 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:37.675603 (+ 2685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.675607 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.675609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.675977 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.676339 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.676343 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.676345 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.676470 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.676936 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:37.676939 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:37.677061 (+ 122us) client_negotiation.cc:769] Sending connection context
0806 10:41:37.677185 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 10:41:37.677392 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 10:41:37.677840 26866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.667171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58420 (local address 127.16.45.125:40553)
0806 10:41:37.667295 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:37.667299 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:37.667313 (+ 14us) server_negotiation.cc:407] Connection header received
0806 10:41:37.667356 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:37.667359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:37.667409 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:37.667477 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:37.668063 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.668770 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.669879 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.670278 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.670428 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.673069 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:37.673074 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:37.673077 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:37.673105 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:37.675466 (+ 2361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.676079 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.676083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.676085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.676216 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.676557 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.676560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.676562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.676802 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:37.676907 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:37.677261 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 10:41:37.677526 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":84,"server-negotiator.queue_time_us":40}
I20260806 10:41:37.682368 26862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: Bootstrap starting.
I20260806 10:41:37.685566 26862 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:37.686607 26862 log.cc:824] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:37.689148 26862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: No bootstrap required, opened a new log
I20260806 10:41:37.696134 26862 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } }
I20260806 10:41:37.696434 26862 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:37.696507 26862 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7801bc445429445198295507aa9e724b, State: Initialized, Role: FOLLOWER
I20260806 10:41:37.697005 26862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } }
I20260806 10:41:37.697834 26871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } } }
I20260806 10:41:37.698237 26871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:41:37.698794 26862 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: configured and running, proceeding with master startup.
W20260806 10:41:37.706650 26883 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 10:41:37.706763 26883 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 10:41:37.710428 26765 master_runner.cc:428] Detected that this master 7801bc445429445198295507aa9e724b is joining an existing cluster
I20260806 10:41:37.710515 26765 master_runner.cc:432] Initiating AddMaster RPC to add 127.16.45.125:40553
I20260806 10:41:37.734110 26892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.714541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54324)
0806 10:41:37.718815 (+ 4274us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:37.718834 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:37.719026 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:37.719593 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:37.719598 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:37.720371 (+ 773us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:37.720779 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.720792 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.722393 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.722399 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.724369 (+ 1970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.724387 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.725708 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.725715 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.725908 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.726610 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:37.726627 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:37.727440 (+ 813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:37.731199 (+ 3759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.731204 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.731208 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.731693 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.732132 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.732137 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.732140 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.732314 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.732996 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:37.733000 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:37.733206 (+ 206us) client_negotiation.cc:769] Sending connection context
0806 10:41:37.733364 (+ 158us) client_negotiation.cc:240] Negotiation successful
0806 10:41:37.733677 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4135,"thread_start_us":3965,"threads_started":1}
I20260806 10:41:37.735199 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.714530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54324 (local address 127.16.45.126:34899)
0806 10:41:37.714828 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:37.714836 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:37.718917 (+ 4081us) server_negotiation.cc:407] Connection header received
0806 10:41:37.719178 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:37.719184 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:37.719280 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:37.719352 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:37.720984 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.722171 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.724558 (+ 2387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.725285 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.725384 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.727651 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:37.727658 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:37.727662 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:37.727702 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:37.731056 (+ 3354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.731830 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.731836 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.731839 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.732005 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.732432 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.732437 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.732441 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.732788 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:37.732940 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:37.734628 (+ 1688us) server_negotiation.cc:299] Negotiation successful
0806 10:41:37.734880 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
WARNING: no policy specified for oryx/127.16.45.124@KRBTEST.COM; defaulting to no policy
I20260806 10:41:37.741816 26866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.719046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58422 (local address 127.16.45.125:40553)
0806 10:41:37.719226 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:37.719231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:37.727933 (+ 8702us) server_negotiation.cc:407] Connection header received
0806 10:41:37.728122 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:37.728126 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:37.728186 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:37.728252 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:37.729419 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.730468 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.732253 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.732889 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.732968 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.735208 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:37.735214 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:37.735218 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:37.735257 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:37.738811 (+ 3554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.739582 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.739587 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.739590 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.739736 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.740150 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.740155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.740158 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.740554 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:37.740680 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:37.741272 (+ 592us) server_negotiation.cc:299] Negotiation successful
0806 10:41:37.741499 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 10:41:37.743088 26893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.719336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:40553 (local address 127.0.0.1:58422)
0806 10:41:37.727822 (+ 8486us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:37.727847 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:37.728017 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:37.728400 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:37.728403 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:37.728988 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:37.729299 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.729312 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.730654 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.730660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.732125 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.732136 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.733261 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.733267 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.733443 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.734019 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:37.734041 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:37.735021 (+ 980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:37.738939 (+ 3918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.738943 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.738947 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.739473 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.739865 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.739869 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.739872 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.740042 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.740764 (+ 722us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:37.740768 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:37.741010 (+ 242us) client_negotiation.cc:769] Sending connection context
0806 10:41:37.742377 (+ 1367us) client_negotiation.cc:240] Negotiation successful
0806 10:41:37.742673 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8356,"thread_start_us":7053,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.124@KRBTEST.COM" created.
Aug 06 10:41:37 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012895, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.126@KRBTEST.COM for oryx/127.16.45.125@KRBTEST.COM
I20260806 10:41:37.763913 26866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.743181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58426 (local address 127.16.45.125:40553)
0806 10:41:37.744262 (+ 1081us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:37.744266 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:37.744283 (+ 17us) server_negotiation.cc:407] Connection header received
0806 10:41:37.744373 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:37.744379 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:37.744449 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:37.744541 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:37.746527 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.747718 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.749580 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.750138 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.750234 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.757708 (+ 7474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:37.757713 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:37.757716 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:37.757746 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:37.761008 (+ 3262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.761798 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.761804 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.761808 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.761952 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.762371 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.762376 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.762380 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.762655 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:37.762792 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:37.763278 (+ 486us) server_negotiation.cc:299] Negotiation successful
0806 10:41:37.763501 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1005,"thread_start_us":10828,"threads_started":1}
I20260806 10:41:37.763937 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.742839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:40553 (local address 127.0.0.1:58426)
0806 10:41:37.743506 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:37.743546 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:37.743709 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:37.744610 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:37.744618 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:37.746002 (+ 1384us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:37.746292 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.746306 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.747922 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.747928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.749440 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.749454 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.750514 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.750518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.750683 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.751315 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:37.751347 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:37.757522 (+ 6175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:37.761192 (+ 3670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.761205 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.761213 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.761675 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.762065 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.762070 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.762074 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.762241 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.762778 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:37.762787 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:37.762966 (+ 179us) client_negotiation.cc:769] Sending connection context
0806 10:41:37.763134 (+ 168us) client_negotiation.cc:240] Negotiation successful
0806 10:41:37.763503 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":613,"threads_started":1}
I20260806 10:41:37.765981 26066 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.16.45.125:40553: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7801bc445429445198295507aa9e724b"
member_type: NON_VOTER
last_known_addr {
host: "127.16.45.125"
port: 40553
}
attrs {
promote: true
}
}
dest_uuid: "fdde3c17390c427e9af52c8cbc0f512b"
cas_config_opid_index: -1
I20260806 10:41:37.767321 26066 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true } }
I20260806 10:41:37.772639 26900 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 7801bc445429445198295507aa9e724b (127.16.45.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true } } }
I20260806 10:41:37.773799 26825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:37.776441 26825 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 FOLLOWER]: Refusing update from remote peer fdde3c17390c427e9af52c8cbc0f512b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 10:41:37.777495 26900 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.16.45.125:40553
I20260806 10:41:37.778627 26765 master.cc:537] Master@127.16.45.125:40553 shutting down...
I20260806 10:41:37.779937 26900 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:37.780169 26901 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true } } }
I20260806 10:41:37.780437 26901 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: This master's current role is: LEADER
W20260806 10:41:37.783468 26050 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260806 10:41:37.785452 26050 consensus_peers.cc:487] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b -> Peer 7801bc445429445198295507aa9e724b (127.16.45.125:40553): Couldn't send request to peer 7801bc445429445198295507aa9e724b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.124.keytab.
Entry for principal oryx/127.16.45.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.124.keytab.
I20260806 10:41:37.790560 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.124:45433
--webserver_interface=127.16.45.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.124.keytab
--principal=oryx/127.16.45.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:36767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:34899,127.16.45.125:40553,127.16.45.124:45433
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:41:37.791262 26765 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:37.791697 26765 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:37.791873 26765 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: stopping tablet replica
I20260806 10:41:37.808977 26765 master.cc:552] Master@127.16.45.125:40553 shutdown complete.
I20260806 10:41:37.809118 26765 master_runner.cc:305] Clearing existing system tablet
I20260806 10:41:37.810642 26765 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:37.810750 26765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:37.814291 26765 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260806 10:41:37.816113 26908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:37.816437 26765 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:37.816715 26765 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 10:41:37.816805 26765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/wal
uuid: "7801bc445429445198295507aa9e724b"
format_stamp: "Formatted at 2026-08-06 10:41:37 on dist-test-slave-fgb3"
server_key: "dd8877f7062707f9c83159886fa7fa32"
server_key_iv: "edf7c90b972f8b45dc8ea603da8ce454"
server_key_version: "encryptionkey@0"
I20260806 10:41:37.822453 26765 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:37.829524 26765 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 10:41:37.829725 26765 log.cc:1196] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 10:41:37.830161 26765 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: Deleting consensus metadata
I20260806 10:41:37.830482 26765 master_runner.cc:315] Copying system tablet from 127.16.45.126:34899
I20260806 10:41:37.833696 26765 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: tablet copy: Beginning tablet copy session from remote peer at address 127.16.45.126:34899
I20260806 10:41:37.850059 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.834821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54328 (local address 127.16.45.126:34899)
0806 10:41:37.835018 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:37.835025 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:37.835545 (+ 520us) server_negotiation.cc:407] Connection header received
0806 10:41:37.835716 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:37.835722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:37.835838 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:37.835964 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:37.837043 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.838200 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.840216 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.840838 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.840972 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.843280 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:37.843287 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:37.843291 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:37.843331 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:37.846973 (+ 3642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.847789 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.847796 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.847799 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.847993 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:37.848424 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:37.848428 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:37.848431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:37.848834 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:37.848989 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:37.849446 (+ 457us) server_negotiation.cc:299] Negotiation successful
0806 10:41:37.849697 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 10:41:37.850138 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:37.834829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54328)
0806 10:41:37.835407 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:37.835426 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:37.835586 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:37.836003 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:37.836008 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:37.836549 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:37.836860 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.836874 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.838391 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.838400 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.839980 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:37.839995 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:37.841003 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:37.841009 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:37.841186 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:37.841916 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:37.841940 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:37.843055 (+ 1115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:37.847120 (+ 4065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.847125 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.847130 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.847652 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.848116 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:37.848122 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:37.848126 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:37.848307 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:37.848969 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:37.848974 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:37.849151 (+ 177us) client_negotiation.cc:769] Sending connection context
0806 10:41:37.849326 (+ 175us) client_negotiation.cc:240] Negotiation successful
0806 10:41:37.849687 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":292,"threads_started":1}
I20260806 10:41:37.851702 26095 tablet_copy_service.cc:140] P fdde3c17390c427e9af52c8cbc0f512b: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7801bc445429445198295507aa9e724b ({username='oryx', principal='oryx/127.16.45.125@KRBTEST.COM'} at 127.0.0.1:54328)
I20260806 10:41:37.852182 26095 tablet_copy_service.cc:161] P fdde3c17390c427e9af52c8cbc0f512b: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7801bc445429445198295507aa9e724b at {username='oryx', principal='oryx/127.16.45.125@KRBTEST.COM'} at 127.0.0.1:54328: session id = 7801bc445429445198295507aa9e724b-00000000000000000000000000000000
I20260806 10:41:37.857026 26095 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 10:41:37.859850 26765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 10:41:37.866683 26765 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: tablet copy: Starting download of 0 data blocks...
I20260806 10:41:37.867110 26765 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: tablet copy: Starting download of 1 WAL segments...
I20260806 10:41:37.871351 26765 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 10:41:37.876240 26095 tablet_copy_service.cc:342] P fdde3c17390c427e9af52c8cbc0f512b: Request end of tablet copy session 7801bc445429445198295507aa9e724b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.16.45.125@KRBTEST.COM'} at 127.0.0.1:54328
I20260806 10:41:37.876559 26095 tablet_copy_service.cc:433] P fdde3c17390c427e9af52c8cbc0f512b: ending tablet copy session 7801bc445429445198295507aa9e724b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7801bc445429445198295507aa9e724b
I20260806 10:41:37.888902 26765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:37.891901 26920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:37.892197 26921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:37.902712 26923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:37.903687 26765 server_base.cc:1034] running on GCE node
I20260806 10:41:37.904068 26765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:37.904784 26765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:37.906021 26765 hybrid_clock.cc:648] HybridClock initialized: now 1786012897905940 us; error 38 us; skew 500 ppm
I20260806 10:41:37.906265 26765 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:37 dist-test-slave-fgb3 krb5kdc[26005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012897, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:37.908632 26765 init.cc:377] Logged in from keytab as oryx/127.16.45.125@KRBTEST.COM (short username oryx)
I20260806 10:41:37.915513 26765 webserver.cc:460] Webserver started at http://127.16.45.125:40837/ using document root <none> and password file <none>
I20260806 10:41:37.915925 26765 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:37.916010 26765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:37.919199 26765 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 10:41:37.921348 26934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:37.922232 26765 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 10:41:37.922428 26765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/wal
uuid: "7801bc445429445198295507aa9e724b"
format_stamp: "Formatted at 2026-08-06 10:41:37 on dist-test-slave-fgb3"
server_key: "dd8877f7062707f9c83159886fa7fa32"
server_key_iv: "edf7c90b972f8b45dc8ea603da8ce454"
server_key_version: "encryptionkey@0"
I20260806 10:41:37.922597 26765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:37.948678 26765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:37.952731 26765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:37.982455 26765 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.125:40553
I20260806 10:41:37.982497 27016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.125:40553 every 8 connection(s)
I20260806 10:41:37.983454 26765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
I20260806 10:41:37.988673 27017 sys_catalog.cc:263] Verifying existing consensus state
I20260806 10:41:37.992682 27017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: Bootstrap starting.
I20260806 10:41:38.012744 27017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 10:41:38.013381 27017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: Bootstrap complete.
I20260806 10:41:38.014636 27017 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true } }
I20260806 10:41:38.015091 27017 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7801bc445429445198295507aa9e724b, State: Initialized, Role: LEARNER
I20260806 10:41:38.015369 27017 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true } }
I20260806 10:41:38.016208 27022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true } } }
I20260806 10:41:38.016479 27017 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:38.016633 27022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: This master's current role is: LEARNER
I20260806 10:41:38.029515 27038 catalog_manager.cc:1259] Loaded cluster ID: 80b420ac56fe4c57bfde83b973b27a4a
I20260806 10:41:38.029644 27038 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: loading cluster ID for follower catalog manager: success
I20260806 10:41:38.033210 27038 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: acquiring CA information for follower catalog manager: success
I20260806 10:41:38.035985 27038 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 10:41:38.145911 26754 heartbeater.cc:503] Master 127.16.45.126:34899 was elected leader, sending a full tablet report...
I20260806 10:41:38.220964 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.204897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:40553 (local address 127.0.0.1:58430)
0806 10:41:38.205200 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:38.205224 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:38.205361 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:38.211390 (+ 6029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:38.211396 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:38.211436 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:38.211662 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.211675 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.214787 (+ 3112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.214793 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.217348 (+ 2555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.217372 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.219848 (+ 2476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.219857 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.220201 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.220284 (+ 83us) client_negotiation.cc:769] Sending connection context
0806 10:41:38.220401 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 10:41:38.220565 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158}
I20260806 10:41:38.221486 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.205931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58430 (local address 127.16.45.125:40553)
0806 10:41:38.210771 (+ 4840us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:38.210798 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:38.210825 (+ 27us) server_negotiation.cc:407] Connection header received
0806 10:41:38.210938 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:38.210945 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:38.211124 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:38.211333 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:38.211969 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.214565 (+ 2596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.217569 (+ 3004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.219580 (+ 2011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.219730 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.220147 (+ 417us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:38.220463 (+ 316us) server_negotiation.cc:299] Negotiation successful
0806 10:41:38.220650 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4655,"thread_start_us":4355,"threads_started":1}
I20260806 10:41:38.224094 26988 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260806 10:41:38.225135 27022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdde3c17390c427e9af52c8cbc0f512b. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true } } }
I20260806 10:41:38.225553 27022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: This master's current role is: LEARNER
W20260806 10:41:38.325536 26905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:38.325992 26905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:38.326236 26905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:38.337368 26905 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:38.337630 26905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:38.337788 26905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:38.337957 26905 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:38.338094 26905 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:38.352547 26905 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:34899,127.16.45.125:40553,127.16.45.124:45433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.124.keytab
--principal=oryx/127.16.45.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.124:45433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.16.45.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:38.354307 26905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:38.355968 26905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:38.371452 27046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:38.371816 27051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:38.371899 27048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:38.377941 26905 server_base.cc:1034] running on GCE node
I20260806 10:41:38.378949 26905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:38.380805 26905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:38.382079 26905 hybrid_clock.cc:648] HybridClock initialized: now 1786012898381964 us; error 46 us; skew 500 ppm
I20260806 10:41:38.382591 26905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:38 dist-test-slave-fgb3 krb5kdc[26005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012898, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:38.387393 26905 init.cc:377] Logged in from keytab as oryx/127.16.45.124@KRBTEST.COM (short username oryx)
I20260806 10:41:38.389714 26905 webserver.cc:460] Webserver started at http://127.16.45.124:45677/ using document root <none> and password file <none>
I20260806 10:41:38.390856 26905 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:38.391093 26905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:38.391516 26905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:38.395887 26905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data/instance:
uuid: "6214f668e6f34f619c4e5216f1827f58"
format_stamp: "Formatted at 2026-08-06 10:41:38 on dist-test-slave-fgb3"
server_key: "ecc654c9e129ad21fe4f391be4c03efc"
server_key_iv: "221c18477187ba4a5e29daeaffa671d3"
server_key_version: "encryptionkey@0"
I20260806 10:41:38.396834 26905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/wal/instance:
uuid: "6214f668e6f34f619c4e5216f1827f58"
format_stamp: "Formatted at 2026-08-06 10:41:38 on dist-test-slave-fgb3"
server_key: "ecc654c9e129ad21fe4f391be4c03efc"
server_key_iv: "221c18477187ba4a5e29daeaffa671d3"
server_key_version: "encryptionkey@0"
I20260806 10:41:38.404083 26905 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260806 10:41:38.408360 27063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:38.409835 26905 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:41:38.410010 26905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/wal
uuid: "6214f668e6f34f619c4e5216f1827f58"
format_stamp: "Formatted at 2026-08-06 10:41:38 on dist-test-slave-fgb3"
server_key: "ecc654c9e129ad21fe4f391be4c03efc"
server_key_iv: "221c18477187ba4a5e29daeaffa671d3"
server_key_version: "encryptionkey@0"
I20260806 10:41:38.410240 26905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:38.425619 26905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:38.430589 26905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:38.430857 26905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:38.462344 26905 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.124:45433
I20260806 10:41:38.462368 27146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.124:45433 every 8 connection(s)
I20260806 10:41:38.464213 26905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
I20260806 10:41:38.468730 27147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:38.472623 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 26905
I20260806 10:41:38.479318 27147 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:41:38 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012898, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.124@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
Aug 06 10:41:38 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.45.124@KRBTEST.COM
I20260806 10:41:38.503971 27152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.482548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54340 (local address 127.16.45.126:34899)
0806 10:41:38.483188 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:38.483195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:38.484134 (+ 939us) server_negotiation.cc:407] Connection header received
0806 10:41:38.484839 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:38.484844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:38.484929 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:38.485017 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:38.486794 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.487856 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.490330 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.490925 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.491015 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.495703 (+ 4688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:38.495708 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:38.495711 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:38.495745 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:38.499691 (+ 3946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.500877 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.500880 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.500883 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.501067 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.501596 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.501601 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.501603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.502072 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:38.502218 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:38.503092 (+ 874us) server_negotiation.cc:299] Negotiation successful
0806 10:41:38.503273 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":337,"threads_started":1}
I20260806 10:41:38.505317 27151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.475050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56782 (local address 127.16.45.124:45433)
0806 10:41:38.480674 (+ 5624us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:38.480689 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:38.481050 (+ 361us) server_negotiation.cc:407] Connection header received
0806 10:41:38.484557 (+ 3507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:38.484585 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:38.484939 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:38.485131 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:38.487133 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.488950 (+ 1817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.490811 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.491834 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.491977 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.497395 (+ 5418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:38.497403 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:38.497416 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:38.497445 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:38.501483 (+ 4038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.502548 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.502556 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.502559 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.502754 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.503123 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.503128 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.503131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.503524 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:38.503826 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:38.504254 (+ 428us) server_negotiation.cc:299] Negotiation successful
0806 10:41:38.504504 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":5378,"thread_start_us":5114,"threads_started":1}
I20260806 10:41:38.505375 27154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.482717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54340)
0806 10:41:38.483988 (+ 1271us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:38.484031 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:38.484564 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:38.485105 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:38.485111 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:38.486064 (+ 953us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:38.486611 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.486632 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.488030 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.488036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.490164 (+ 2128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.490176 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.491277 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.491290 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.491755 (+ 465us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.492532 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:38.492563 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:38.495499 (+ 2936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:38.499836 (+ 4337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.499848 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.499862 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.500764 (+ 902us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.501186 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.501191 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.501194 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.501500 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.502180 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:38.502186 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:38.502600 (+ 414us) client_negotiation.cc:769] Sending connection context
0806 10:41:38.502920 (+ 320us) client_negotiation.cc:240] Negotiation successful
0806 10:41:38.503411 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1008,"mutex_wait_us":36,"thread_start_us":711,"threads_started":1}
I20260806 10:41:38.507385 27147 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:41:38 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012898, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.124@KRBTEST.COM for oryx/127.16.45.125@KRBTEST.COM
I20260806 10:41:38.521956 27154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.508023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:40553 (local address 127.0.0.1:58438)
0806 10:41:38.508186 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:38.508209 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:38.508307 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:38.508761 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:38.508764 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:38.509302 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:38.509468 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.509476 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.510530 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.510533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.511587 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.511599 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.512343 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.512347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.512520 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.513052 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:38.513068 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:38.515675 (+ 2607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:38.519293 (+ 3618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.519298 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.519303 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.519681 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.520137 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.520142 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.520146 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.520285 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.520788 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:38.520792 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:38.520939 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 10:41:38.521056 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 10:41:38.521461 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 10:41:38.521944 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.508263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58438 (local address 127.16.45.125:40553)
0806 10:41:38.508460 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:38.508467 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:38.508490 (+ 23us) server_negotiation.cc:407] Connection header received
0806 10:41:38.508553 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:38.508560 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:38.508635 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:38.508742 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:38.509631 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.510431 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.511721 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.512215 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.512312 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.515978 (+ 3666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:38.515987 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:38.515991 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:38.516036 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:38.519158 (+ 3122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.519795 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.519800 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.519802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.520023 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.520384 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.520389 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.520391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.520663 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:38.520809 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:38.521178 (+ 369us) server_negotiation.cc:299] Negotiation successful
0806 10:41:38.521428 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 10:41:38.523625 27147 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:41:38 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012898, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.124@KRBTEST.COM for oryx/127.16.45.124@KRBTEST.COM
I20260806 10:41:38.538704 27154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.524408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:45433 (local address 127.0.0.1:56786)
0806 10:41:38.524559 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:38.524573 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:38.524659 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:38.524993 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:38.524997 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:38.525559 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:38.525844 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.525853 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.527166 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.527170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.528263 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.528275 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.529119 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.529125 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.529389 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.529860 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:38.529877 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:38.532180 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:38.536013 (+ 3833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.536018 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.536022 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.536380 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.536807 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.536812 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.536815 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.536968 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.537579 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:38.537583 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:38.537715 (+ 132us) client_negotiation.cc:769] Sending connection context
0806 10:41:38.537859 (+ 144us) client_negotiation.cc:240] Negotiation successful
0806 10:41:38.538126 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 10:41:38.538766 27151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.524613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56786 (local address 127.16.45.124:45433)
0806 10:41:38.524767 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:38.524772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:38.524787 (+ 15us) server_negotiation.cc:407] Connection header received
0806 10:41:38.524821 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:38.524824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:38.524887 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:38.524959 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:38.525968 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.527054 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.528384 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.528963 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.529100 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.532393 (+ 3293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:38.532398 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:38.532402 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:38.532428 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:38.535857 (+ 3429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.536485 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.536490 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.536493 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.536702 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.537066 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.537070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.537073 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.537469 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:38.537598 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:38.538010 (+ 412us) server_negotiation.cc:299] Negotiation successful
0806 10:41:38.538244 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":54}
I20260806 10:41:38.544304 27147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: Bootstrap starting.
I20260806 10:41:38.548472 27147 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:38.549815 27147 log.cc:824] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:38.553542 27147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: No bootstrap required, opened a new log
I20260806 10:41:38.565778 27147 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } }
I20260806 10:41:38.566155 27147 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:38.566391 27147 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6214f668e6f34f619c4e5216f1827f58, State: Initialized, Role: FOLLOWER
I20260806 10:41:38.567101 27147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } }
I20260806 10:41:38.568441 27158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } } }
I20260806 10:41:38.568871 27158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:41:38.569583 27147 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 10:41:38.584805 27172 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 10:41:38.585072 27172 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 10:41:38.589144 26905 master_runner.cc:428] Detected that this master 6214f668e6f34f619c4e5216f1827f58 is joining an existing cluster
I20260806 10:41:38.589365 26905 master_runner.cc:432] Initiating AddMaster RPC to add 127.16.45.124:45433
I20260806 10:41:38.613240 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 26154
I20260806 10:41:38.628883 27183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.598259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54344)
0806 10:41:38.600495 (+ 2236us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:38.600508 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:38.600768 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:38.601418 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:38.601423 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:38.606858 (+ 5435us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:38.608087 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.608108 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.610106 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.610112 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.613651 (+ 3539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.613666 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.615507 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.615515 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.616039 (+ 524us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.616913 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:38.616940 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:38.618986 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:38.625640 (+ 6654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.625645 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.625648 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.626180 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.626668 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.626672 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.626676 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.626851 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.627639 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:38.627645 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:38.627875 (+ 230us) client_negotiation.cc:769] Sending connection context
0806 10:41:38.628012 (+ 137us) client_negotiation.cc:240] Negotiation successful
0806 10:41:38.628357 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2070,"thread_start_us":1485,"threads_started":1}
I20260806 10:41:38.630060 27152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.597305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54344 (local address 127.16.45.126:34899)
0806 10:41:38.597533 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:38.597539 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:38.600660 (+ 3121us) server_negotiation.cc:407] Connection header received
0806 10:41:38.600976 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:38.600983 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:38.601078 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:38.601191 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:38.608320 (+ 7129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.609831 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.613834 (+ 4003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.614960 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.615064 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.619193 (+ 4129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:38.619200 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:38.619204 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:38.619247 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:38.625476 (+ 6229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.626363 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.626369 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.626373 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.626530 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.626992 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.626997 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.627000 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.627439 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:38.627571 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:38.629433 (+ 1862us) server_negotiation.cc:299] Negotiation successful
0806 10:41:38.629677 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 10:41:38.630295 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.602168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58442 (local address 127.16.45.125:40553)
0806 10:41:38.602424 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:38.602430 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:38.608358 (+ 5928us) server_negotiation.cc:407] Connection header received
0806 10:41:38.608667 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:38.608673 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:38.608759 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:38.608830 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:38.612989 (+ 4159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.614237 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.617480 (+ 3243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.618547 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.618647 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.623302 (+ 4655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:38.623309 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:38.623313 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:38.623355 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:38.627092 (+ 3737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.627956 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.627961 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.627965 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.628113 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.628554 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.628559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.628563 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.628893 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:38.629011 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:38.629616 (+ 605us) server_negotiation.cc:299] Negotiation successful
0806 10:41:38.629850 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 10:41:38.632589 27184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.602386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:40553 (local address 127.0.0.1:58442)
0806 10:41:38.608163 (+ 5777us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:38.608211 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:38.608494 (+ 283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:38.609145 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:38.609151 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:38.611663 (+ 2512us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:38.612772 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.612786 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.614480 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.614484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.617306 (+ 2822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.617321 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.619315 (+ 1994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.619324 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.619854 (+ 530us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.621583 (+ 1729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:38.621605 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:38.623089 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:38.627241 (+ 4152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.627246 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.627249 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.627823 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.628252 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.628256 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.628259 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.628421 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.629100 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:38.629105 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:38.629324 (+ 219us) client_negotiation.cc:769] Sending connection context
0806 10:41:38.630615 (+ 1291us) client_negotiation.cc:240] Negotiation successful
0806 10:41:38.631707 (+ 1092us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5568,"thread_start_us":4614,"threads_started":1}
I20260806 10:41:38.640578 27182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.597870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:45433 (local address 127.0.0.1:56792)
0806 10:41:38.600428 (+ 2558us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:38.600479 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:38.600835 (+ 356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:38.601145 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:38.601149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:38.607656 (+ 6507us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:38.608782 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.608796 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.611859 (+ 3063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.611863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.621234 (+ 9371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.621251 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.624399 (+ 3148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.624406 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.624577 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.629530 (+ 4953us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:38.629551 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:38.631413 (+ 1862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:38.636510 (+ 5097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.636515 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.636518 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.637099 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.637620 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.637624 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.637627 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.637885 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.638874 (+ 989us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:38.638878 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:38.639149 (+ 271us) client_negotiation.cc:769] Sending connection context
0806 10:41:38.639329 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 10:41:38.639664 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2302,"mutex_wait_us":1,"spinlock_wait_cycles":21376,"thread_start_us":1467,"threads_started":1}
I20260806 10:41:38.641541 27151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.597325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56792 (local address 127.16.45.124:45433)
0806 10:41:38.597527 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:38.597533 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:38.600676 (+ 3143us) server_negotiation.cc:407] Connection header received
0806 10:41:38.600962 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:38.600967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:38.601031 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:38.601122 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:38.608923 (+ 7801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.610673 (+ 1750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.622783 (+ 12110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.624033 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.624147 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.631582 (+ 7435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:38.631589 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:38.631598 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:38.631636 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:38.636315 (+ 4679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.637223 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.637227 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.637230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.637500 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.638023 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.638027 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.638029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.638687 (+ 658us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:38.638827 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:38.640420 (+ 1593us) server_negotiation.cc:299] Negotiation successful
0806 10:41:38.640654 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
Aug 06 10:41:38 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.45.65@KRBTEST.COM
Aug 06 10:41:38 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012895, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.126@KRBTEST.COM for oryx/127.16.45.124@KRBTEST.COM
I20260806 10:41:38.656219 27185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.615688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53304 (local address 127.16.45.65:34031)
0806 10:41:38.627484 (+ 11796us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:38.627494 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:38.627527 (+ 33us) server_negotiation.cc:407] Connection header received
0806 10:41:38.627640 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:38.627650 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:38.627954 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:38.631118 (+ 3164us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:38.631425 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.633075 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.635993 (+ 2918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.638767 (+ 2774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.639730 (+ 963us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.645316 (+ 5586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:38.645331 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:38.645352 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:38.645408 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:38.651065 (+ 5657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.652407 (+ 1342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.652417 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.652421 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.652712 (+ 291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.653365 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.653372 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.653375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.654031 (+ 656us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:38.654586 (+ 555us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:38.655066 (+ 480us) server_negotiation.cc:299] Negotiation successful
0806 10:41:38.655412 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11530,"thread_start_us":12539,"threads_started":1}
I20260806 10:41:38.658349 26335 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:38.658705 27188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.636728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56806 (local address 127.16.45.124:45433)
0806 10:41:38.638503 (+ 1775us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:38.638507 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:38.638550 (+ 43us) server_negotiation.cc:407] Connection header received
0806 10:41:38.638652 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:38.638656 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:38.638741 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:38.639927 (+ 1186us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:38.640592 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.643151 (+ 2559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.645331 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.646053 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.646164 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.650376 (+ 4212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:38.650385 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:38.650390 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:38.650428 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:38.655349 (+ 4921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.656440 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.656445 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.656448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.656626 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.657026 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.657031 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.657035 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.657330 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:38.657459 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:38.657857 (+ 398us) server_negotiation.cc:299] Negotiation successful
0806 10:41:38.658071 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1543,"thread_start_us":1229,"threads_started":1}
I20260806 10:41:38.659031 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.636658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:45433 (local address 127.0.0.1:56806)
0806 10:41:38.637009 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:38.637027 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:38.637143 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:38.638907 (+ 1764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:38.638912 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:38.639544 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:38.639783 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.639796 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.643344 (+ 3548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.643350 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.645156 (+ 1806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.645172 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.646204 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.646210 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.646433 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.647013 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:38.647037 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:38.650061 (+ 3024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:38.655511 (+ 5450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.655517 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.655521 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.656252 (+ 731us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.656782 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.656787 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.656791 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.656919 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.657461 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:38.657466 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:38.657617 (+ 151us) client_negotiation.cc:769] Sending connection context
0806 10:41:38.657743 (+ 126us) client_negotiation.cc:240] Negotiation successful
0806 10:41:38.658062 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194}
I20260806 10:41:38.660974 26066 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.16.45.124:45433: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "6214f668e6f34f619c4e5216f1827f58"
member_type: NON_VOTER
last_known_addr {
host: "127.16.45.124"
port: 45433
}
attrs {
promote: true
}
}
dest_uuid: "fdde3c17390c427e9af52c8cbc0f512b"
cas_config_opid_index: 5
I20260806 10:41:38.662148 26066 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } }
I20260806 10:41:38.664173 26900 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 6214f668e6f34f619c4e5216f1827f58 (127.16.45.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } } }
I20260806 10:41:38.667932 26988 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 LEARNER]: Refusing update from remote peer fdde3c17390c427e9af52c8cbc0f512b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 10:41:38.670379 27110 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:38.678843 27110 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 FOLLOWER]: Refusing update from remote peer fdde3c17390c427e9af52c8cbc0f512b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
W20260806 10:41:38.683380 27072 tablet.cc:2369] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:41:38.683704 26900 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.16.45.124:45433
I20260806 10:41:38.686455 26900 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } } }
I20260806 10:41:38.686893 27191 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260806 10:41:38.687549 26900 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:38.688581 27193 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:38.691164 26905 master.cc:537] Master@127.16.45.124:45433 shutting down...
W20260806 10:41:38.702688 26049 consensus_peers.cc:487] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b -> Peer 6214f668e6f34f619c4e5216f1827f58 (127.16.45.124:45433): Couldn't send request to peer 6214f668e6f34f619c4e5216f1827f58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 10:41:38.705636 26988 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 6214f668e6f34f619c4e5216f1827f58 (127.16.45.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } } }
I20260806 10:41:38.709287 27022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: NON_VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: true } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } } }
I20260806 10:41:38.709617 27022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: This master's current role is: LEARNER
I20260806 10:41:38.710209 27193 raft_consensus.cc:1050] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b: attempting to promote NON_VOTER 7801bc445429445198295507aa9e724b to VOTER
I20260806 10:41:38.711138 27193 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } }
W20260806 10:41:38.713753 26049 consensus_peers.cc:487] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b -> Peer 6214f668e6f34f619c4e5216f1827f58 (127.16.45.124:45433): Couldn't send request to peer 6214f668e6f34f619c4e5216f1827f58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 10:41:38.714159 26988 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 LEARNER]: Refusing update from remote peer fdde3c17390c427e9af52c8cbc0f512b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 10:41:38.714686 27193 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260806 10:41:38.716908 26900 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 7801bc445429445198295507aa9e724b (127.16.45.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } } }
I20260806 10:41:38.720927 27191 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } } }
I20260806 10:41:38.721536 27191 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:38.720552 27195 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } } }
I20260806 10:41:38.722474 27195 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:38.723079 26988 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 7801bc445429445198295507aa9e724b (127.16.45.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } } }
I20260806 10:41:38.727341 27022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } } }
I20260806 10:41:38.727692 27022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:41:38.729027 26905 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:38.729454 26905 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:38.729772 26905 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: stopping tablet replica
I20260806 10:41:38.737453 26905 master.cc:552] Master@127.16.45.124:45433 shutdown complete.
I20260806 10:41:38.737545 26905 master_runner.cc:305] Clearing existing system tablet
I20260806 10:41:38.737939 26905 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:38.738071 26905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:38.741451 26905 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 10:41:38.743332 27203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:38.743835 26905 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:38.744323 26905 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 10:41:38.744500 26905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/wal
uuid: "6214f668e6f34f619c4e5216f1827f58"
format_stamp: "Formatted at 2026-08-06 10:41:38 on dist-test-slave-fgb3"
server_key: "ecc654c9e129ad21fe4f391be4c03efc"
server_key_iv: "221c18477187ba4a5e29daeaffa671d3"
server_key_version: "encryptionkey@0"
I20260806 10:41:38.750571 26905 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:38.760934 26905 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 10:41:38.761427 26905 log.cc:1196] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 10:41:38.762349 26905 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: Deleting consensus metadata
I20260806 10:41:38.762750 26905 master_runner.cc:315] Copying system tablet from 127.16.45.126:34899
I20260806 10:41:38.766856 26905 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: tablet copy: Beginning tablet copy session from remote peer at address 127.16.45.126:34899
I20260806 10:41:38.793120 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 26154
I20260806 10:41:38.796736 27152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.767961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54352 (local address 127.16.45.126:34899)
0806 10:41:38.768327 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:38.768333 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:38.779519 (+ 11186us) server_negotiation.cc:407] Connection header received
0806 10:41:38.779761 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:38.779767 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:38.779857 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:38.779981 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:38.781768 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.782891 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.785237 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.785945 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.786071 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.789325 (+ 3254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:38.789331 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:38.789336 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:38.789379 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:38.792669 (+ 3290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.794175 (+ 1506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.794180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.794184 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.794379 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:38.794828 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:38.794834 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:38.794837 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:38.795239 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:38.795396 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:38.796068 (+ 672us) server_negotiation.cc:299] Negotiation successful
0806 10:41:38.796326 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222}
I20260806 10:41:38.797927 27210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:38.767873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54352)
0806 10:41:38.779304 (+ 11431us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:38.779372 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:38.779603 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:38.780038 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:38.780043 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:38.780999 (+ 956us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:38.781577 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.781594 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.783050 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.783057 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.785072 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:38.785088 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:38.786125 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:38.786132 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:38.786450 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:38.787445 (+ 995us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:38.787469 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:38.789067 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:38.792835 (+ 3768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.792841 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.792845 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.793293 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.794511 (+ 1218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:38.794515 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:38.794523 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:38.794708 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:38.795505 (+ 797us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:38.795510 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:38.795739 (+ 229us) client_negotiation.cc:769] Sending connection context
0806 10:41:38.797013 (+ 1274us) client_negotiation.cc:240] Negotiation successful
0806 10:41:38.797396 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11097,"thread_start_us":10853,"threads_started":1}
I20260806 10:41:38.798820 26095 tablet_copy_service.cc:140] P fdde3c17390c427e9af52c8cbc0f512b: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 6214f668e6f34f619c4e5216f1827f58 ({username='oryx', principal='oryx/127.16.45.124@KRBTEST.COM'} at 127.0.0.1:54352)
I20260806 10:41:38.799011 26095 tablet_copy_service.cc:161] P fdde3c17390c427e9af52c8cbc0f512b: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 6214f668e6f34f619c4e5216f1827f58 at {username='oryx', principal='oryx/127.16.45.124@KRBTEST.COM'} at 127.0.0.1:54352: session id = 6214f668e6f34f619c4e5216f1827f58-00000000000000000000000000000000
I20260806 10:41:38.803655 26095 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 10:41:38.805914 26905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 10:41:38.813601 26905 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: tablet copy: Starting download of 0 data blocks...
I20260806 10:41:38.813926 26905 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: tablet copy: Starting download of 1 WAL segments...
I20260806 10:41:38.817377 26905 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 10:41:38.818423 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:34031
--local_ip_for_outbound_sockets=127.16.45.65
--tserver_master_addrs=127.16.45.126:34899
--webserver_port=36351
--webserver_interface=127.16.45.65
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab
--principal=oryx/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:36767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.16.45.126:34899,127.16.45.125:40553
--tserver_master_addrs=127.16.45.126:34899,127.16.45.125:40553,127.16.45.124:45433 with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:41:38.822201 26095 tablet_copy_service.cc:342] P fdde3c17390c427e9af52c8cbc0f512b: Request end of tablet copy session 6214f668e6f34f619c4e5216f1827f58-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.16.45.124@KRBTEST.COM'} at 127.0.0.1:54352
I20260806 10:41:38.822373 26095 tablet_copy_service.cc:433] P fdde3c17390c427e9af52c8cbc0f512b: ending tablet copy session 6214f668e6f34f619c4e5216f1827f58-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 6214f668e6f34f619c4e5216f1827f58
I20260806 10:41:38.832824 26905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:38.835278 27212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:38.841598 27213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:38.848573 27215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:38.849262 26905 server_base.cc:1034] running on GCE node
I20260806 10:41:38.849592 26905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:38.850374 26905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:38.851557 26905 hybrid_clock.cc:648] HybridClock initialized: now 1786012898851494 us; error 49 us; skew 500 ppm
I20260806 10:41:38.851819 26905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:38 dist-test-slave-fgb3 krb5kdc[26005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012898, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:38.853747 26905 init.cc:377] Logged in from keytab as oryx/127.16.45.124@KRBTEST.COM (short username oryx)
I20260806 10:41:38.861292 26905 webserver.cc:460] Webserver started at http://127.16.45.124:39515/ using document root <none> and password file <none>
I20260806 10:41:38.861600 26905 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:38.861701 26905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:38.864244 26905 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 10:41:38.865927 27223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:38.866375 26905 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260806 10:41:38.866495 26905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/wal
uuid: "6214f668e6f34f619c4e5216f1827f58"
format_stamp: "Formatted at 2026-08-06 10:41:38 on dist-test-slave-fgb3"
server_key: "ecc654c9e129ad21fe4f391be4c03efc"
server_key_iv: "221c18477187ba4a5e29daeaffa671d3"
server_key_version: "encryptionkey@0"
I20260806 10:41:38.866663 26905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:38.873421 26905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:38.876770 26905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:38.911067 26905 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.124:45433
I20260806 10:41:38.911092 27298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.124:45433 every 8 connection(s)
I20260806 10:41:38.912125 26905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
I20260806 10:41:38.917851 27301 sys_catalog.cc:263] Verifying existing consensus state
I20260806 10:41:38.922294 27301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: Bootstrap starting.
I20260806 10:41:38.936182 27301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 10:41:38.936635 27301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: Bootstrap complete.
I20260806 10:41:38.937465 27301 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } }
I20260806 10:41:38.937692 27301 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6214f668e6f34f619c4e5216f1827f58, State: Initialized, Role: LEARNER
I20260806 10:41:38.937927 27301 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } }
I20260806 10:41:38.938849 27305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } } }
I20260806 10:41:38.939147 27301 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:38.939342 27305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: This master's current role is: LEARNER
I20260806 10:41:38.950731 27322 catalog_manager.cc:1259] Loaded cluster ID: 80b420ac56fe4c57bfde83b973b27a4a
I20260806 10:41:38.950910 27322 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: loading cluster ID for follower catalog manager: success
I20260806 10:41:38.953652 27322 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: acquiring CA information for follower catalog manager: success
I20260806 10:41:38.955611 27322 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 10:41:39.289286 27323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:39.278546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:45433 (local address 127.0.0.1:56808)
0806 10:41:39.282784 (+ 4238us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:39.282811 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:39.283007 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:39.283461 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:39.283467 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:39.283499 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:39.283737 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:39.283751 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.285045 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.285051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:39.286989 (+ 1938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:39.287007 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.288480 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.288487 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:39.288674 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:39.288713 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 10:41:39.288823 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 10:41:39.288976 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4092,"thread_start_us":3981,"threads_started":1}
I20260806 10:41:39.289511 27324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:39.278844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56808 (local address 127.16.45.124:45433)
0806 10:41:39.283131 (+ 4287us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:39.283136 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:39.283159 (+ 23us) server_negotiation.cc:407] Connection header received
0806 10:41:39.283222 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:39.283226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:39.283295 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:39.283401 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:39.283922 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.284896 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.287127 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.288296 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.288397 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:39.288609 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:39.288837 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 10:41:39.288984 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4175,"thread_start_us":4020,"threads_started":1}
I20260806 10:41:39.290702 27260 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260806 10:41:39.291417 27305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdde3c17390c427e9af52c8cbc0f512b. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } } }
I20260806 10:41:39.291807 27305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: This master's current role is: LEARNER
W20260806 10:41:39.326484 27211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:39.326889 27211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:39.327122 27211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:39.335894 27211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:39.336076 27211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:39.336334 27211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:41:39.349735 27211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab
--principal=oryx/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:34031
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=36351
--tserver_master_addrs=127.16.45.126:34899,127.16.45.125:40553,127.16.45.124:45433
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:39.351471 27211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:39.353283 27211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:39.369398 27329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:39.369954 27336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:39.369990 27332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:39.371258 27211 server_base.cc:1034] running on GCE node
I20260806 10:41:39.371996 27211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:39.373179 27211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:39.374465 27211 hybrid_clock.cc:648] HybridClock initialized: now 1786012899374355 us; error 33 us; skew 500 ppm
I20260806 10:41:39.374857 27211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:39 dist-test-slave-fgb3 krb5kdc[26005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012899, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:39.379158 27211 init.cc:377] Logged in from keytab as oryx/127.16.45.65@KRBTEST.COM (short username oryx)
I20260806 10:41:39.380976 27211 webserver.cc:460] Webserver started at http://127.16.45.65:36351/ using document root <none> and password file <none>
I20260806 10:41:39.381825 27211 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:39.381954 27211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:39.387514 27211 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 10:41:39.390717 27347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:39.392166 27211 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 10:41:39.392398 27211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "63364df350a640d0864f873f77a07209"
format_stamp: "Formatted at 2026-08-06 10:41:36 on dist-test-slave-fgb3"
server_key: "32c7a1c13f48bdcc8dbcb85baeb0b00b"
server_key_iv: "3185dfafca1ef3ae5479525e6aea8587"
server_key_version: "encryptionkey@0"
I20260806 10:41:39.393778 27211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:39.412739 27211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:39.418299 27211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:39.418769 27211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:39.420382 27211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:39.422044 27211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:39.422132 27211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:39.422233 27211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:39.422302 27211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:39.499953 27211 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:34031
I20260806 10:41:39.500195 27512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:34031 every 8 connection(s)
I20260806 10:41:39.501713 27211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:41:39.512516 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 27211
I20260806 10:41:39.513043 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 26348
Aug 06 10:41:39 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012899, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
Aug 06 10:41:39 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012899, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.125@KRBTEST.COM
Aug 06 10:41:39 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012899, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.124@KRBTEST.COM
I20260806 10:41:39.537894 27324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:39.506178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:40437 (local address 127.16.45.124:45433)
0806 10:41:39.506569 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:39.506574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:39.509117 (+ 2543us) server_negotiation.cc:407] Connection header received
0806 10:41:39.512708 (+ 3591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:39.512716 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:39.512801 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:39.512891 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:39.515499 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.516897 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.520829 (+ 3932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.521684 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.521807 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:39.529066 (+ 7259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:39.529072 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:39.529075 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:39.529110 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:39.533450 (+ 4340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:39.534751 (+ 1301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:39.534757 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:39.534761 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:39.534934 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:39.535511 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:39.535515 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:39.535518 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:39.535934 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:39.536115 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:39.537183 (+ 1068us) server_negotiation.cc:299] Negotiation successful
0806 10:41:39.537432 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274}
I20260806 10:41:39.538223 27532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:39.509388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:35023 (local address 127.16.45.126:34899)
0806 10:41:39.510087 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:39.510094 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:39.510543 (+ 449us) server_negotiation.cc:407] Connection header received
0806 10:41:39.513743 (+ 3200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:39.513758 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:39.513839 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:39.513943 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:39.518411 (+ 4468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.519663 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.521802 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.522457 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.522586 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:39.529001 (+ 6415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:39.529007 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:39.529011 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:39.529048 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:39.533556 (+ 4508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:39.534979 (+ 1423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:39.534985 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:39.534989 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:39.535207 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:39.535720 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:39.535725 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:39.535729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:39.536045 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:39.536186 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:39.537426 (+ 1240us) server_negotiation.cc:299] Negotiation successful
0806 10:41:39.537655 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":441,"threads_started":1}
I20260806 10:41:39.540459 27525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:39.506967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:45433 (local address 127.16.45.65:40437)
0806 10:41:39.508816 (+ 1849us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:39.508871 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:39.512357 (+ 3486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:39.513081 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:39.513085 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:39.513897 (+ 812us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:39.515275 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:39.515304 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.517106 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.517112 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:39.520610 (+ 3498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:39.520625 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.522235 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.522244 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:39.522771 (+ 527us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:39.524509 (+ 1738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:39.524539 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:39.528768 (+ 4229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:39.533634 (+ 4866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:39.533645 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:39.533664 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:39.534594 (+ 930us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:39.535086 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:39.535091 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:39.535094 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:39.535376 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:39.536209 (+ 833us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:39.536217 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:39.536720 (+ 503us) client_negotiation.cc:769] Sending connection context
0806 10:41:39.538130 (+ 1410us) client_negotiation.cc:240] Negotiation successful
0806 10:41:39.538432 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1711,"mutex_wait_us":158,"spinlock_wait_cycles":25088,"thread_start_us":1201,"threads_started":1}
I20260806 10:41:39.540808 27526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:39.506817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:40553 (local address 127.16.45.65:33577)
0806 10:41:39.508812 (+ 1995us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:39.508869 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:39.512344 (+ 3475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:39.513066 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:39.513074 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:39.513899 (+ 825us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:39.515782 (+ 1883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:39.515798 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.517597 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.517603 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:39.520641 (+ 3038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:39.520657 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.522649 (+ 1992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.522660 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:39.522991 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:39.524138 (+ 1147us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:39.524166 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:39.528604 (+ 4438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:39.534795 (+ 6191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:39.534799 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:39.534802 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:39.535350 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:39.535807 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:39.535812 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:39.535816 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:39.535967 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:39.536594 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:39.536598 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:39.536754 (+ 156us) client_negotiation.cc:769] Sending connection context
0806 10:41:39.537064 (+ 310us) client_negotiation.cc:240] Negotiation successful
0806 10:41:39.537726 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1615,"mutex_wait_us":191,"spinlock_wait_cycles":46720,"thread_start_us":1229,"threads_started":1}
I20260806 10:41:39.540494 27530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:39.509382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.65:35023)
0806 10:41:39.510292 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:39.510306 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:39.513568 (+ 3262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:39.514111 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:39.514116 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:39.514731 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:39.518130 (+ 3399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:39.518146 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.519863 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.519868 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:39.521632 (+ 1764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:39.521647 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.522879 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.522887 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:39.523099 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:39.523784 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:39.523817 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:39.528797 (+ 4980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:39.533735 (+ 4938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:39.533741 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:39.533745 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:39.534778 (+ 1033us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:39.535355 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:39.535361 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:39.535364 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:39.535596 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:39.536324 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:39.536328 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:39.536720 (+ 392us) client_negotiation.cc:769] Sending connection context
0806 10:41:39.537065 (+ 345us) client_negotiation.cc:240] Negotiation successful
0806 10:41:39.538790 (+ 1725us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":1326,"spinlock_wait_cycles":63488,"thread_start_us":647,"threads_started":1}
I20260806 10:41:39.542544 27515 heartbeater.cc:347] Connected to a master server at 127.16.45.124:45433
I20260806 10:41:39.542888 27524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:39.505858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:33577 (local address 127.16.45.125:40553)
0806 10:41:39.506643 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:39.506649 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:39.509145 (+ 2496us) server_negotiation.cc:407] Connection header received
0806 10:41:39.512607 (+ 3462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:39.512613 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:39.512705 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:39.512800 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:39.516004 (+ 3204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.517459 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.520881 (+ 3422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.521872 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.521983 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:39.528968 (+ 6985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:39.528977 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:39.528982 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:39.529026 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:39.534663 (+ 5637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:39.535515 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:39.535520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:39.535523 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:39.535675 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:39.536108 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:39.536112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:39.536115 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:39.536453 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:39.540091 (+ 3638us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:39.540310 (+ 219us) server_negotiation.cc:299] Negotiation successful
0806 10:41:39.540843 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":483,"threads_started":1}
I20260806 10:41:39.542984 27515 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:39.543931 27521 heartbeater.cc:347] Connected to a master server at 127.16.45.125:40553
I20260806 10:41:39.544144 27521 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:39.544453 27519 heartbeater.cc:347] Connected to a master server at 127.16.45.126:34899
I20260806 10:41:39.544462 27515 heartbeater.cc:511] Master 127.16.45.124:45433 requested a full tablet report, sending...
I20260806 10:41:39.544705 27519 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:39.545421 27521 heartbeater.cc:511] Master 127.16.45.125:40553 requested a full tablet report, sending...
I20260806 10:41:39.546085 27519 heartbeater.cc:511] Master 127.16.45.126:34899 requested a full tablet report, sending...
Aug 06 10:41:39 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.45.66@KRBTEST.COM
I20260806 10:41:39.547650 27246 ts_manager.cc:194] Registered new tserver with Master: 63364df350a640d0864f873f77a07209 (127.16.45.65:34031)
I20260806 10:41:39.547694 26973 ts_manager.cc:194] Registered new tserver with Master: 63364df350a640d0864f873f77a07209 (127.16.45.65:34031)
I20260806 10:41:39.549191 26066 ts_manager.cc:194] Re-registered known tserver with Master: 63364df350a640d0864f873f77a07209 (127.16.45.65:34031)
I20260806 10:41:39.550362 26066 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:35023
I20260806 10:41:39.558462 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:39.514751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34344 (local address 127.16.45.66:38487)
0806 10:41:39.515834 (+ 1083us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:39.515842 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:39.527220 (+ 11378us) server_negotiation.cc:407] Connection header received
0806 10:41:39.530598 (+ 3378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:39.530612 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:39.530949 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:39.531093 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:39.534152 (+ 3059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.536047 (+ 1895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.538419 (+ 2372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:39.539925 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:39.540043 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:39.549859 (+ 9816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:39.549881 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:39.549898 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:39.549946 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:39.554960 (+ 5014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:39.556067 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:39.556075 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:39.556077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:39.556353 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:39.556785 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:39.556790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:39.556792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:39.557210 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:39.557566 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:39.557800 (+ 234us) server_negotiation.cc:299] Negotiation successful
0806 10:41:39.558018 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":883,"thread_start_us":543,"threads_started":1}
I20260806 10:41:39.559993 26540 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:39.651714 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 26348
I20260806 10:41:39.672984 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:38487
--local_ip_for_outbound_sockets=127.16.45.66
--tserver_master_addrs=127.16.45.126:34899
--webserver_port=33069
--webserver_interface=127.16.45.66
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab
--principal=oryx/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:36767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.16.45.126:34899,127.16.45.125:40553
--tserver_master_addrs=127.16.45.126:34899,127.16.45.125:40553,127.16.45.124:45433 with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:41:39.709398 27195 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: NON_VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: true } } }
I20260806 10:41:39.709715 27195 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:39.711033 27195 raft_consensus.cc:1050] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b: attempting to promote NON_VOTER 6214f668e6f34f619c4e5216f1827f58 to VOTER
I20260806 10:41:39.711786 27195 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } }
I20260806 10:41:39.713665 27260 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 LEARNER]: Refusing update from remote peer fdde3c17390c427e9af52c8cbc0f512b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260806 10:41:39.713665 26988 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 FOLLOWER]: Refusing update from remote peer fdde3c17390c427e9af52c8cbc0f512b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260806 10:41:39.714375 27538 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260806 10:41:39.714771 27195 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260806 10:41:39.717856 26988 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 6214f668e6f34f619c4e5216f1827f58 (127.16.45.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } } }
I20260806 10:41:39.720901 27260 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 6214f668e6f34f619c4e5216f1827f58 (127.16.45.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } } }
I20260806 10:41:39.717226 27195 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 6214f668e6f34f619c4e5216f1827f58 (127.16.45.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } } }
I20260806 10:41:39.724792 27539 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } } }
I20260806 10:41:39.725057 27539 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:39.725342 27539 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } } }
I20260806 10:41:39.725556 27539 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:39.725445 27305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } } }
I20260806 10:41:39.725709 27305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:41:39.725813 27539 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } } }
I20260806 10:41:39.725976 27539 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:39.726781 27543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fdde3c17390c427e9af52c8cbc0f512b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } } }
I20260806 10:41:39.727358 27543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: This master's current role is: FOLLOWER
W20260806 10:41:40.010540 27537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:40.010842 27537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:40.010985 27537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:40.018356 27537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:40.018484 27537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:40.018615 27537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:41:40.028844 27537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab
--principal=oryx/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:38487
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=33069
--tserver_master_addrs=127.16.45.126:34899,127.16.45.125:40553,127.16.45.124:45433
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:40.030195 27537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:40.031563 27537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:40.045576 27549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:40.045534 27550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:40.045598 27552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:40.046350 27537 server_base.cc:1034] running on GCE node
I20260806 10:41:40.047041 27537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:40.048622 27537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:40.049835 27537 hybrid_clock.cc:648] HybridClock initialized: now 1786012900049780 us; error 47 us; skew 500 ppm
I20260806 10:41:40.050129 27537 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:40 dist-test-slave-fgb3 krb5kdc[26005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012900, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:40.053468 27537 init.cc:377] Logged in from keytab as oryx/127.16.45.66@KRBTEST.COM (short username oryx)
I20260806 10:41:40.054997 27537 webserver.cc:460] Webserver started at http://127.16.45.66:33069/ using document root <none> and password file <none>
I20260806 10:41:40.055709 27537 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:40.055826 27537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:40.061738 27537 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 10:41:40.064776 27562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:40.066428 27537 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:40.066614 27537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "4399de29d9e74ea3a18f8f563cc4f62e"
format_stamp: "Formatted at 2026-08-06 10:41:36 on dist-test-slave-fgb3"
server_key: "9db1d10c89bbb703cfa3727358d529e9"
server_key_iv: "7a1d4aa37a5c4053f01ae18f5805a60d"
server_key_version: "encryptionkey@0"
I20260806 10:41:40.067816 27537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:40.090341 27537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:40.094596 27537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:40.094844 27537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:40.095873 27537 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:40.097259 27537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:40.097352 27537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:40.097478 27537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:40.097553 27537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:40.129261 27537 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:38487
I20260806 10:41:40.129333 27728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:38487 every 8 connection(s)
I20260806 10:41:40.130869 27537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:41:40.136456 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 27537
I20260806 10:41:40.136775 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 26557
Aug 06 10:41:40 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.45.67@KRBTEST.COM
Aug 06 10:41:40 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012900, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.125@KRBTEST.COM
Aug 06 10:41:40 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012900, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
Aug 06 10:41:40 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012900, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.124@KRBTEST.COM
I20260806 10:41:40.179792 27748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.138196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58252 (local address 127.16.45.67:41305)
0806 10:41:40.142909 (+ 4713us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.142920 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.152119 (+ 9199us) server_negotiation.cc:407] Connection header received
0806 10:41:40.152324 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.152335 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.152646 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.154417 (+ 1771us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:40.155161 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.156352 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.158546 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.159579 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.159690 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.168455 (+ 8765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:40.168477 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:40.168495 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:40.168571 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:40.174376 (+ 5805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.175616 (+ 1240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.175627 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.175631 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.175863 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.176324 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.176329 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.176332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.176885 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:40.177172 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.178742 (+ 1570us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.179110 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4490,"thread_start_us":4284,"threads_started":1}
I20260806 10:41:40.181699 26749 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:40.185204 27738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.133874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:52377 (local address 127.16.45.125:40553)
0806 10:41:40.146735 (+ 12861us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.146741 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.153354 (+ 6613us) server_negotiation.cc:407] Connection header received
0806 10:41:40.156513 (+ 3159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.156519 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.156603 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.156698 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:40.160104 (+ 3406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.161613 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.165013 (+ 3400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.165510 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.165605 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.173312 (+ 7707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:40.173319 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:40.173324 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:40.173372 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:40.178340 (+ 4968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.181858 (+ 3518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.181863 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.181867 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.182111 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.182752 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.182758 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.182761 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.183234 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:40.183416 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.184383 (+ 967us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.184650 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12733,"thread_start_us":12612,"threads_started":1}
I20260806 10:41:40.185817 27742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.134546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:45433 (local address 127.16.45.66:49855)
0806 10:41:40.153137 (+ 18591us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:40.153408 (+ 271us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:40.156173 (+ 2765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:40.157329 (+ 1156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:40.157333 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:40.158201 (+ 868us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:40.159578 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.159606 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.161853 (+ 2247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.161857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.166129 (+ 4272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.166145 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.168499 (+ 2354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.168507 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.168702 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.169397 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:40.169421 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:40.173519 (+ 4098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:40.178618 (+ 5099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:40.178629 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:40.178649 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:40.180491 (+ 1842us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:40.181961 (+ 1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:40.181967 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:40.181970 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:40.182409 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:40.183315 (+ 906us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:40.183324 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:40.183793 (+ 469us) client_negotiation.cc:769] Sending connection context
0806 10:41:40.184143 (+ 350us) client_negotiation.cc:240] Negotiation successful
0806 10:41:40.184696 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18422,"mutex_wait_us":192,"spinlock_wait_cycles":109440,"thread_start_us":17925,"threads_started":1}
I20260806 10:41:40.186297 27739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.133967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:49855 (local address 127.16.45.124:45433)
0806 10:41:40.146266 (+ 12299us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.146273 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.153483 (+ 7210us) server_negotiation.cc:407] Connection header received
0806 10:41:40.156940 (+ 3457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.156946 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.157032 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.157111 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:40.159797 (+ 2686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.161655 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.166295 (+ 4640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.167335 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.167474 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.173794 (+ 6320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:40.173801 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:40.173806 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:40.173897 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:40.178454 (+ 4557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.180692 (+ 2238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.180698 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.180702 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.180927 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.182594 (+ 1667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.182600 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.182603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.183087 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:40.183235 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.185581 (+ 2346us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.185851 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12157,"thread_start_us":12341,"threads_started":1}
I20260806 10:41:40.187570 27729 heartbeater.cc:347] Connected to a master server at 127.16.45.124:45433
I20260806 10:41:40.187939 27729 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:40.188781 27743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.134546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:40553 (local address 127.16.45.66:52377)
0806 10:41:40.153137 (+ 18591us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:40.153226 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:40.156170 (+ 2944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:40.156990 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:40.157003 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:40.158222 (+ 1219us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:40.159915 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.159928 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.161892 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.161897 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.164802 (+ 2905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.164819 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.165914 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.165927 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.166134 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.166943 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:40.166979 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:40.173062 (+ 6083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:40.178866 (+ 5804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:40.178871 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:40.178874 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:40.181696 (+ 2822us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:40.182263 (+ 567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:40.182268 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:40.182271 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:40.182579 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:40.183496 (+ 917us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:40.183500 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:40.183792 (+ 292us) client_negotiation.cc:769] Sending connection context
0806 10:41:40.184143 (+ 351us) client_negotiation.cc:240] Negotiation successful
0806 10:41:40.187846 (+ 3703us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18254,"mutex_wait_us":2127,"spinlock_wait_cycles":14976,"thread_start_us":18087,"threads_started":1}
I20260806 10:41:40.189672 27750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.153953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:50827 (local address 127.16.45.126:34899)
0806 10:41:40.155155 (+ 1202us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.155161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.155182 (+ 21us) server_negotiation.cc:407] Connection header received
0806 10:41:40.156597 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.156603 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.156680 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.156788 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:40.159814 (+ 3026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.161140 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.165563 (+ 4423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.167076 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.167197 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.172811 (+ 5614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:40.172818 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:40.172822 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:40.172906 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:40.181995 (+ 9089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.184440 (+ 2445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.184445 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.184449 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.184614 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.187292 (+ 2678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.187296 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.187299 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.187619 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:40.188161 (+ 542us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.189212 (+ 1051us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.189415 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1046,"spinlock_wait_cycles":33536,"thread_start_us":1021,"threads_started":1}
I20260806 10:41:40.189100 27729 heartbeater.cc:511] Master 127.16.45.124:45433 requested a full tablet report, sending...
I20260806 10:41:40.189942 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.153842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.66:50827)
0806 10:41:40.154446 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:40.154465 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:40.156163 (+ 1698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:40.157941 (+ 1778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:40.157946 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:40.158543 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:40.159578 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.159606 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.162141 (+ 2535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.162147 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.164942 (+ 2795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.164959 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.167700 (+ 2741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.167707 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.167906 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.169124 (+ 1218us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:40.169148 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:40.172494 (+ 3346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:40.182485 (+ 9991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:40.182492 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:40.182496 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:40.183176 (+ 680us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:40.186553 (+ 3377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:40.186559 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:40.186563 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:40.186780 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:40.188499 (+ 1719us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:40.188505 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:40.188753 (+ 248us) client_negotiation.cc:769] Sending connection context
0806 10:41:40.188920 (+ 167us) client_negotiation.cc:240] Negotiation successful
0806 10:41:40.189272 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"mutex_wait_us":105,"thread_start_us":285,"threads_started":1}
I20260806 10:41:40.191186 27733 heartbeater.cc:347] Connected to a master server at 127.16.45.125:40553
I20260806 10:41:40.191219 27730 heartbeater.cc:347] Connected to a master server at 127.16.45.126:34899
I20260806 10:41:40.191385 27733 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:40.191406 27730 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:40.192354 27246 ts_manager.cc:194] Registered new tserver with Master: 4399de29d9e74ea3a18f8f563cc4f62e (127.16.45.66:38487)
I20260806 10:41:40.192373 27733 heartbeater.cc:511] Master 127.16.45.125:40553 requested a full tablet report, sending...
I20260806 10:41:40.192579 27730 heartbeater.cc:511] Master 127.16.45.126:34899 requested a full tablet report, sending...
I20260806 10:41:40.193715 26973 ts_manager.cc:194] Registered new tserver with Master: 4399de29d9e74ea3a18f8f563cc4f62e (127.16.45.66:38487)
I20260806 10:41:40.194252 26066 ts_manager.cc:194] Re-registered known tserver with Master: 4399de29d9e74ea3a18f8f563cc4f62e (127.16.45.66:38487)
I20260806 10:41:40.195744 26066 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:50827
I20260806 10:41:40.279493 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 26557
I20260806 10:41:40.299702 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:41305
--local_ip_for_outbound_sockets=127.16.45.67
--tserver_master_addrs=127.16.45.126:34899
--webserver_port=41751
--webserver_interface=127.16.45.67
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab
--principal=oryx/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:36767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.16.45.126:34899,127.16.45.125:40553
--tserver_master_addrs=127.16.45.126:34899,127.16.45.125:40553,127.16.45.124:45433 with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:41:40.552925 27519 heartbeater.cc:503] Master 127.16.45.126:34899 was elected leader, sending a full tablet report...
W20260806 10:41:40.631522 27757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:40.631814 27757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:40.631920 27757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:40.639273 27757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:40.639396 27757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:40.639519 27757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:41:40.649956 27757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab
--principal=oryx/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:41305
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=41751
--tserver_master_addrs=127.16.45.126:34899,127.16.45.125:40553,127.16.45.124:45433
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:40.651376 27757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:40.652684 27757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:40.667049 27763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:40.667418 27769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:40.667440 27764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:40.668640 27757 server_base.cc:1034] running on GCE node
I20260806 10:41:40.669292 27757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:40.670235 27757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:40.671483 27757 hybrid_clock.cc:648] HybridClock initialized: now 1786012900671421 us; error 53 us; skew 500 ppm
I20260806 10:41:40.671823 27757 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:40 dist-test-slave-fgb3 krb5kdc[26005](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012900, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:40.674827 27757 init.cc:377] Logged in from keytab as oryx/127.16.45.67@KRBTEST.COM (short username oryx)
I20260806 10:41:40.676229 27757 webserver.cc:460] Webserver started at http://127.16.45.67:41751/ using document root <none> and password file <none>
I20260806 10:41:40.676893 27757 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:40.677026 27757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:40.683364 27757 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 10:41:40.686038 27782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:40.687463 27757 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 10:41:40.687613 27757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "48df401686594af9a76e6559fa33de78"
format_stamp: "Formatted at 2026-08-06 10:41:37 on dist-test-slave-fgb3"
server_key: "189e6218ff99b95ec3df67277428dce9"
server_key_iv: "7e309f8c86d7841d00b3a21ffc32dd77"
server_key_version: "encryptionkey@0"
I20260806 10:41:40.688551 27757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:40.707079 27757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:40.711272 27757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:40.711562 27757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:40.712507 27757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:40.713886 27757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:40.713984 27757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:40.714095 27757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:40.714165 27757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:40.746021 27757 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:41305
I20260806 10:41:40.746088 27943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:41305 every 8 connection(s)
I20260806 10:41:40.747547 27757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:41:40.753074 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 27757
Aug 06 10:41:40 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012900, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.124@KRBTEST.COM
I20260806 10:41:40.791935 27949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.750772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:36615 (local address 127.16.45.124:45433)
0806 10:41:40.751456 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.751463 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.752480 (+ 1017us) server_negotiation.cc:407] Connection header received
0806 10:41:40.755172 (+ 2692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.755179 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.755260 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.755365 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:40.757884 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.759107 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.761686 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.762430 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.762549 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.769036 (+ 6487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:40.769044 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:40.769048 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:40.769092 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:40.772637 (+ 3545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.773918 (+ 1281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.773923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.773927 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.774068 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.774690 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.774695 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.774700 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.775087 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:40.775220 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.791004 (+ 15784us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.791355 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":415,"threads_started":1}
Aug 06 10:41:40 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012900, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
Aug 06 10:41:40 dist-test-slave-fgb3 krb5kdc[26005](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012900, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.125@KRBTEST.COM
I20260806 10:41:40.794632 27950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.751066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:45433 (local address 127.16.45.67:36615)
0806 10:41:40.752333 (+ 1267us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:40.752362 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:40.754757 (+ 2395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:40.755658 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:40.755670 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:40.756845 (+ 1175us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:40.757663 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.757691 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.759304 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.759311 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.761500 (+ 2189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.761517 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.762875 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.762882 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.763195 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.764413 (+ 1218us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:40.764447 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:40.768768 (+ 4321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:40.772815 (+ 4047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:40.772824 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:40.772842 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:40.773764 (+ 922us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:40.774230 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:40.774234 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:40.774238 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:40.774543 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:40.775367 (+ 824us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:40.775377 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:40.775870 (+ 493us) client_negotiation.cc:769] Sending connection context
0806 10:41:40.792201 (+ 16331us) client_negotiation.cc:240] Negotiation successful
0806 10:41:40.792895 (+ 694us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1138,"mutex_wait_us":132,"spinlock_wait_cycles":14592,"thread_start_us":596,"threads_started":1}
I20260806 10:41:40.796365 27944 heartbeater.cc:347] Connected to a master server at 127.16.45.124:45433
I20260806 10:41:40.796710 27944 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:40.798177 27944 heartbeater.cc:511] Master 127.16.45.124:45433 requested a full tablet report, sending...
I20260806 10:41:40.800680 27246 ts_manager.cc:194] Registered new tserver with Master: 48df401686594af9a76e6559fa33de78 (127.16.45.67:41305)
I20260806 10:41:40.807938 27961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.756883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56814 (local address 127.16.45.124:45433)
0806 10:41:40.778902 (+ 22019us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.778910 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.778931 (+ 21us) server_negotiation.cc:407] Connection header received
0806 10:41:40.778983 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.778988 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.779061 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.782027 (+ 2966us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:40.782257 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.783841 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.786404 (+ 2563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.787521 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.788517 (+ 996us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.794452 (+ 5935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:40.794461 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:40.794467 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:40.794507 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:40.802994 (+ 8487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.804894 (+ 1900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.804900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.804904 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.805082 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.805554 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.805559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.805563 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.805946 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:40.807030 (+ 1084us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.807172 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.807446 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21828,"thread_start_us":21705,"threads_started":1}
I20260806 10:41:40.814795 27948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.750462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:41069 (local address 127.16.45.125:40553)
0806 10:41:40.751853 (+ 1391us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.751860 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.752481 (+ 621us) server_negotiation.cc:407] Connection header received
0806 10:41:40.756131 (+ 3650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.756137 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.756221 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.756335 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:40.765212 (+ 8877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.766303 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.771571 (+ 5268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.772210 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.772318 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.802923 (+ 30605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:40.802933 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:40.802938 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:40.802984 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:40.810752 (+ 7768us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x60c0000347b8. stack: 00007f86eb0db66e 00007f86eb0db430 00007f86ea1625ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f86eb0d10fd 00007f86eb0d1977 00007f86f1be869d 00007f86f1c04963 00007f86f1bfe01e 00007f86f1bf78a5 00007f86f1b65ea5 00007f86f1b64eff 00007f86f1b9882f 00007f86f1b9858d
0806 10:41:40.810799 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.811644 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.811650 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.811652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.812056 (+ 404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.812733 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.812737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.812740 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.813171 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:40.813323 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.813918 (+ 595us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.814193 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1265,"spinlock_wait_cycles":3170688,"thread_start_us":1115,"threads_started":1}
I20260806 10:41:40.815999 27952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.751040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:40553 (local address 127.16.45.67:41069)
0806 10:41:40.752310 (+ 1270us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:40.752360 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:40.755959 (+ 3599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:40.756398 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:40.756403 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:40.763970 (+ 7567us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:40.764238 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.764249 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.766544 (+ 2295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.766549 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.770276 (+ 3727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.770292 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.772637 (+ 2345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.772643 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.772842 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.773791 (+ 949us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:40.773814 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:40.799363 (+ 25549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:40.810945 (+ 11582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:40.810951 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:40.810955 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:40.811491 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:40.812183 (+ 692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:40.812188 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:40.812191 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:40.812584 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:40.813413 (+ 829us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:40.813418 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:40.813615 (+ 197us) client_negotiation.cc:769] Sending connection context
0806 10:41:40.814997 (+ 1382us) client_negotiation.cc:240] Negotiation successful
0806 10:41:40.815391 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":948,"thread_start_us":843,"threads_started":1}
I20260806 10:41:40.817245 27946 heartbeater.cc:347] Connected to a master server at 127.16.45.125:40553
I20260806 10:41:40.817425 27946 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:40.818563 27946 heartbeater.cc:511] Master 127.16.45.125:40553 requested a full tablet report, sending...
I20260806 10:41:40.818688 27963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.757292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54368 (local address 127.16.45.126:34899)
0806 10:41:40.777556 (+ 20264us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.777563 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.777585 (+ 22us) server_negotiation.cc:407] Connection header received
0806 10:41:40.777644 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.777650 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.777729 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.777844 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:40.781528 (+ 3684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.782957 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.784953 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.785833 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.785938 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.799283 (+ 13345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:40.799292 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:40.799297 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:40.799341 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:40.812659 (+ 13318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.813613 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.813619 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.813623 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.813870 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.814494 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.814499 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.814503 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.814985 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:40.815389 (+ 404us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.816929 (+ 1540us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.818135 (+ 1206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20100,"thread_start_us":19908,"threads_started":1}
I20260806 10:41:40.819873 27955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.753498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:60435 (local address 127.16.45.126:34899)
0806 10:41:40.753950 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.753956 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.753978 (+ 22us) server_negotiation.cc:407] Connection header received
0806 10:41:40.755172 (+ 1194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.755179 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.755277 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.755917 (+ 640us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:40.764238 (+ 8321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.767386 (+ 3148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.776104 (+ 8718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.776914 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.777047 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.796496 (+ 19449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:40.796502 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:40.796508 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:40.796558 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:40.813715 (+ 17157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.816241 (+ 2526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.816245 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.816247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.816511 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.817019 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.817024 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.817026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.817555 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:40.817682 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.819114 (+ 1432us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.819372 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":215,"threads_started":1}
I20260806 10:41:40.821393 26973 ts_manager.cc:194] Registered new tserver with Master: 48df401686594af9a76e6559fa33de78 (127.16.45.67:41305)
I20260806 10:41:40.821455 27953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.752911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.67:60435)
0806 10:41:40.753435 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:40.753453 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:40.754755 (+ 1302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:40.755658 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:40.755670 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:40.756723 (+ 1053us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:40.759020 (+ 2297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.759033 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.767516 (+ 8483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.767521 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.768986 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.768998 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.778460 (+ 9462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.778467 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.778677 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.779976 (+ 1299us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:40.780002 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:40.794345 (+ 14343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:40.815207 (+ 20862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:40.815212 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:40.815225 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:40.816098 (+ 873us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:40.816652 (+ 554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:40.816656 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:40.816660 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:40.816887 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:40.817682 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:40.817687 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:40.817857 (+ 170us) client_negotiation.cc:769] Sending connection context
0806 10:41:40.818012 (+ 155us) client_negotiation.cc:240] Negotiation successful
0806 10:41:40.818372 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":3,"spinlock_wait_cycles":896,"thread_start_us":264,"threads_started":1}
I20260806 10:41:40.821974 27971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.775124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58446 (local address 127.16.45.125:40553)
0806 10:41:40.789985 (+ 14861us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.789992 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.790017 (+ 25us) server_negotiation.cc:407] Connection header received
0806 10:41:40.790079 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.790084 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.790172 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.798243 (+ 8071us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:40.800007 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.802437 (+ 2430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.804630 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.805413 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.806176 (+ 763us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.809938 (+ 3762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:40.809947 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:40.809953 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:40.810008 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:40.816290 (+ 6282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.817419 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.817423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.817426 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.817785 (+ 359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:40.818384 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:40.818389 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:40.818392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:40.818825 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:40.820688 (+ 1863us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.820809 (+ 121us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.821324 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14705,"thread_start_us":15172,"threads_started":1}
I20260806 10:41:40.823035 27945 heartbeater.cc:347] Connected to a master server at 127.16.45.126:34899
I20260806 10:41:40.823230 27945 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:40.824379 27945 heartbeater.cc:511] Master 127.16.45.126:34899 requested a full tablet report, sending...
I20260806 10:41:40.825665 26066 ts_manager.cc:194] Re-registered known tserver with Master: 48df401686594af9a76e6559fa33de78 (127.16.45.67:41305)
I20260806 10:41:40.826977 26066 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:60435
I20260806 10:41:40.826797 26068 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54368:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:41:40.840145 26068 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:40.887665 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.868671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58262 (local address 127.16.45.67:41305)
0806 10:41:40.870462 (+ 1791us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.870473 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.871983 (+ 1510us) server_negotiation.cc:407] Connection header received
0806 10:41:40.872393 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.872403 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.872762 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.872983 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:40.875135 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.877990 (+ 2855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.882531 (+ 4541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.885202 (+ 2671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.885314 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.885588 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.886717 (+ 1129us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.886974 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1444,"thread_start_us":1113,"threads_started":1}
I20260806 10:41:40.888780 27989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.868112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:41305 (local address 127.0.0.1:58262)
0806 10:41:40.871712 (+ 3600us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:40.871732 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:40.872149 (+ 417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:40.873649 (+ 1500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:40.873655 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:40.873684 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:40.874770 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.874793 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.878288 (+ 3495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.878294 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.882244 (+ 3950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.882264 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.886090 (+ 3826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.886101 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.886472 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.886512 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 10:41:40.887983 (+ 1471us) client_negotiation.cc:240] Negotiation successful
0806 10:41:40.888142 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3395,"thread_start_us":3118,"threads_started":1}
I20260806 10:41:40.894912 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.869363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53320 (local address 127.16.45.65:34031)
0806 10:41:40.870556 (+ 1193us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.870566 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.883919 (+ 13353us) server_negotiation.cc:407] Connection header received
0806 10:41:40.884222 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.884233 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.884463 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.884689 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:40.886078 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.887536 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.891363 (+ 3827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.893107 (+ 1744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.893255 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.893514 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.894177 (+ 663us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.894405 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":981,"thread_start_us":725,"threads_started":1}
I20260806 10:41:40.895406 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.868605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:34031 (local address 127.0.0.1:53320)
0806 10:41:40.883765 (+ 15160us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:40.883786 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:40.883959 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:40.884691 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:40.884696 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:40.884723 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:40.885734 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.885746 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.887713 (+ 1967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.887718 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.891202 (+ 3484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.891214 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.893530 (+ 2316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.893540 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.893922 (+ 382us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.893957 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 10:41:40.894058 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 10:41:40.894388 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14968,"mutex_wait_us":79,"thread_start_us":15477,"threads_started":1}
I20260806 10:41:40.894773 27851 tablet_service.cc:1467] Processing CreateTablet for tablet 7ecb6b40fa694f298b65e31bea41e5b8 (DEFAULT_TABLE table=test-table [id=a7aa0671012f4e8aa0b02a5ccfcf56db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:40.897583 27851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ecb6b40fa694f298b65e31bea41e5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:40.899511 27412 tablet_service.cc:1467] Processing CreateTablet for tablet 7ecb6b40fa694f298b65e31bea41e5b8 (DEFAULT_TABLE table=test-table [id=a7aa0671012f4e8aa0b02a5ccfcf56db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:40.900379 27995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.872054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34354 (local address 127.16.45.66:38487)
0806 10:41:40.879436 (+ 7382us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:40.879445 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:40.887196 (+ 7751us) server_negotiation.cc:407] Connection header received
0806 10:41:40.887403 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:40.887411 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:40.887722 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:40.888001 (+ 279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:40.890697 (+ 2696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.892694 (+ 1997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.896767 (+ 4073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.898566 (+ 1799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.898739 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.899048 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:40.899610 (+ 562us) server_negotiation.cc:299] Negotiation successful
0806 10:41:40.899859 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7172,"thread_start_us":6879,"threads_started":1}
I20260806 10:41:40.900388 27993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:40.871759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:38487 (local address 127.0.0.1:34354)
0806 10:41:40.887040 (+ 15281us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:40.887062 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:40.887229 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:40.889338 (+ 2109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:40.889343 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:40.889369 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:40.890449 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.890464 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.892913 (+ 2449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.892918 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.896620 (+ 3702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:40.896636 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:40.899062 (+ 2426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:40.899070 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:40.899384 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:40.899422 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 10:41:40.899517 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 10:41:40.899656 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14993,"mutex_wait_us":23,"thread_start_us":15570,"threads_started":1}
I20260806 10:41:40.901575 27412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ecb6b40fa694f298b65e31bea41e5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:40.904714 27641 tablet_service.cc:1467] Processing CreateTablet for tablet 7ecb6b40fa694f298b65e31bea41e5b8 (DEFAULT_TABLE table=test-table [id=a7aa0671012f4e8aa0b02a5ccfcf56db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:40.906436 27641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ecb6b40fa694f298b65e31bea41e5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:40.928010 27996 tablet_bootstrap.cc:492] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78: Bootstrap starting.
I20260806 10:41:40.932183 27998 tablet_bootstrap.cc:492] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209: Bootstrap starting.
I20260806 10:41:40.936321 27999 tablet_bootstrap.cc:492] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e: Bootstrap starting.
I20260806 10:41:40.938565 27998 tablet_bootstrap.cc:654] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:40.938879 27996 tablet_bootstrap.cc:654] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:40.940855 27998 log.cc:824] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:40.941407 27996 log.cc:824] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:40.942561 27999 tablet_bootstrap.cc:654] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:40.944733 27999 log.cc:824] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:40.945881 27996 tablet_bootstrap.cc:492] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78: No bootstrap required, opened a new log
I20260806 10:41:40.946045 27998 tablet_bootstrap.cc:492] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209: No bootstrap required, opened a new log
I20260806 10:41:40.946331 27996 ts_tablet_manager.cc:1397] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.006s
I20260806 10:41:40.946508 27998 ts_tablet_manager.cc:1397] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.011s
I20260806 10:41:40.951161 27999 tablet_bootstrap.cc:492] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e: No bootstrap required, opened a new log
I20260806 10:41:40.951599 27999 ts_tablet_manager.cc:1397] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.011s
I20260806 10:41:40.960017 27998 raft_consensus.cc:348] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } } peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } }
I20260806 10:41:40.960724 27998 raft_consensus.cc:374] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:40.960922 27998 raft_consensus.cc:729] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63364df350a640d0864f873f77a07209, State: Initialized, Role: FOLLOWER
I20260806 10:41:40.961607 27998 consensus_queue.cc:260] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } } peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } }
I20260806 10:41:40.962304 27996 raft_consensus.cc:348] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } } peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } }
I20260806 10:41:40.963049 27996 raft_consensus.cc:374] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:40.963239 27996 raft_consensus.cc:729] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48df401686594af9a76e6559fa33de78, State: Initialized, Role: FOLLOWER
I20260806 10:41:40.964237 27998 ts_tablet_manager.cc:1428] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209: Time spent starting tablet: real 0.018s user 0.000s sys 0.017s
I20260806 10:41:40.964066 27996 consensus_queue.cc:260] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } } peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } }
I20260806 10:41:40.970845 27999 raft_consensus.cc:348] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } } peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } }
I20260806 10:41:40.971635 27999 raft_consensus.cc:374] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:40.971868 27999 raft_consensus.cc:729] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4399de29d9e74ea3a18f8f563cc4f62e, State: Initialized, Role: FOLLOWER
I20260806 10:41:40.972798 27999 consensus_queue.cc:260] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } } peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } }
I20260806 10:41:40.974072 27996 ts_tablet_manager.cc:1428] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78: Time spent starting tablet: real 0.027s user 0.018s sys 0.008s
I20260806 10:41:40.974865 27945 heartbeater.cc:503] Master 127.16.45.126:34899 was elected leader, sending a full tablet report...
I20260806 10:41:40.975687 27730 heartbeater.cc:503] Master 127.16.45.126:34899 was elected leader, sending a full tablet report...
I20260806 10:41:40.979182 27999 ts_tablet_manager.cc:1428] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e: Time spent starting tablet: real 0.027s user 0.003s sys 0.019s
W20260806 10:41:41.001420 27947 tablet.cc:2369] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:41:41.007611 27523 tablet.cc:2369] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:41:41.073827 28004 raft_consensus.cc:482] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:41.074419 28004 raft_consensus.cc:504] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } } peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } }
I20260806 10:41:41.076848 28004 leader_election.cc:288] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63364df350a640d0864f873f77a07209 (127.16.45.65:34031), 4399de29d9e74ea3a18f8f563cc4f62e (127.16.45.66:38487)
I20260806 10:41:41.084573 27992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:41.077410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:51071 (local address 127.16.45.65:34031)
0806 10:41:41.077742 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:41.077748 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:41.077771 (+ 23us) server_negotiation.cc:407] Connection header received
0806 10:41:41.077856 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:41.077861 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:41.077943 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:41.078062 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:41.078764 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.079856 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.082128 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.083426 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.083612 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:41.083694 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:41.084049 (+ 355us) server_negotiation.cc:299] Negotiation successful
0806 10:41:41.084186 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 10:41:41.084649 27953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:41.077003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:34031 (local address 127.16.45.67:51071)
0806 10:41:41.077378 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:41.077398 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:41.077540 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:41.078151 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:41.078157 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:41.078188 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:41.078604 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:41.078616 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.080040 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.080043 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:41.081979 (+ 1936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:41.081991 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.083611 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.083617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:41.083895 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:41.083921 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 10:41:41.084008 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 10:41:41.084208 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":62}
I20260806 10:41:41.085078 27952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:41.077686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:38487 (local address 127.16.45.67:39607)
0806 10:41:41.077935 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:41.077949 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:41.078067 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:41.078374 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:41.078379 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:41.078407 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:41.078787 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:41.078797 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.080206 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.080210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:41.082207 (+ 1997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:41.082219 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.083930 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.083938 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:41.084282 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:41.084307 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 10:41:41.084392 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 10:41:41.084527 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":32}
I20260806 10:41:41.085099 27995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:41.077327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:39607 (local address 127.16.45.66:38487)
0806 10:41:41.077591 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:41.077597 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:41.078047 (+ 450us) server_negotiation.cc:407] Connection header received
0806 10:41:41.078196 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:41.078201 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:41.078259 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:41.078359 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:41.078978 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.080048 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.082382 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.083729 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.083873 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:41.083948 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:41.084444 (+ 496us) server_negotiation.cc:299] Negotiation successful
0806 10:41:41.084578 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 10:41:41.086171 27442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ecb6b40fa694f298b65e31bea41e5b8" candidate_uuid: "48df401686594af9a76e6559fa33de78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63364df350a640d0864f873f77a07209" is_pre_election: true
I20260806 10:41:41.086437 27667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ecb6b40fa694f298b65e31bea41e5b8" candidate_uuid: "48df401686594af9a76e6559fa33de78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" is_pre_election: true
I20260806 10:41:41.086972 27442 raft_consensus.cc:2454] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48df401686594af9a76e6559fa33de78 in term 0.
I20260806 10:41:41.087213 27667 raft_consensus.cc:2454] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48df401686594af9a76e6559fa33de78 in term 0.
I20260806 10:41:41.088255 27788 leader_election.cc:302] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48df401686594af9a76e6559fa33de78, 63364df350a640d0864f873f77a07209; no voters:
I20260806 10:41:41.088815 28004 raft_consensus.cc:2781] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:41.089039 28004 raft_consensus.cc:482] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:41.089211 28004 raft_consensus.cc:3037] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:41.093297 28004 raft_consensus.cc:504] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } } peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } }
I20260806 10:41:41.094187 28004 leader_election.cc:288] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [CANDIDATE]: Term 1 election: Requested vote from peers 63364df350a640d0864f873f77a07209 (127.16.45.65:34031), 4399de29d9e74ea3a18f8f563cc4f62e (127.16.45.66:38487)
I20260806 10:41:41.094919 27667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ecb6b40fa694f298b65e31bea41e5b8" candidate_uuid: "48df401686594af9a76e6559fa33de78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4399de29d9e74ea3a18f8f563cc4f62e"
I20260806 10:41:41.094915 27442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ecb6b40fa694f298b65e31bea41e5b8" candidate_uuid: "48df401686594af9a76e6559fa33de78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63364df350a640d0864f873f77a07209"
I20260806 10:41:41.095239 27667 raft_consensus.cc:3037] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:41.095247 27442 raft_consensus.cc:3037] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:41.100419 27442 raft_consensus.cc:2454] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48df401686594af9a76e6559fa33de78 in term 1.
I20260806 10:41:41.100414 27667 raft_consensus.cc:2454] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48df401686594af9a76e6559fa33de78 in term 1.
I20260806 10:41:41.101118 27784 leader_election.cc:302] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4399de29d9e74ea3a18f8f563cc4f62e, 48df401686594af9a76e6559fa33de78; no voters:
I20260806 10:41:41.101615 28004 raft_consensus.cc:2781] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:41.102568 28004 raft_consensus.cc:686] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 1 LEADER]: Becoming Leader. State: Replica: 48df401686594af9a76e6559fa33de78, State: Running, Role: LEADER
I20260806 10:41:41.103332 28004 consensus_queue.cc:237] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } } peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } }
I20260806 10:41:41.109625 26068 catalog_manager.cc:5495] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48df401686594af9a76e6559fa33de78 (127.16.45.67). New cstate: current_term: 1 leader_uuid: "48df401686594af9a76e6559fa33de78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } health_report { overall_health: UNKNOWN } } }
W20260806 10:41:41.133930 27734 tablet.cc:2369] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:41:41.181596 27991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:41.174520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58264 (local address 127.16.45.67:41305)
0806 10:41:41.174748 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:41.174753 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:41.175092 (+ 339us) server_negotiation.cc:407] Connection header received
0806 10:41:41.175324 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:41.175328 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:41.175408 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:41.175550 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:41.176062 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.177117 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.179113 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.179746 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.179850 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:41.180488 (+ 638us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:41.181012 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:41.181142 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:41.181240 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 10:41:41.181313 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 10:41:41.192374 27667 raft_consensus.cc:1261] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e [term 1 FOLLOWER]: Refusing update from remote peer 48df401686594af9a76e6559fa33de78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:41.192780 27442 raft_consensus.cc:1261] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209 [term 1 FOLLOWER]: Refusing update from remote peer 48df401686594af9a76e6559fa33de78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:41.193655 28007 consensus_queue.cc:1035] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:41.194190 28004 consensus_queue.cc:1035] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:41.210708 28016 mvcc.cc:205] Tried to move back new op lower bound from 7315508843272163328 to 7315508842923487232. Current Snapshot: MvccSnapshot[applied={T|T < 7315508843272163328}]
I20260806 10:41:41.215906 28018 mvcc.cc:205] Tried to move back new op lower bound from 7315508843272163328 to 7315508842923487232. Current Snapshot: MvccSnapshot[applied={T|T < 7315508843272163328}]
I20260806 10:41:41.232020 26068 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:41.232347 26068 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:41.240677 26068 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fdde3c17390c427e9af52c8cbc0f512b: Sending DeleteTablet for 3 replicas of tablet 7ecb6b40fa694f298b65e31bea41e5b8
I20260806 10:41:41.242072 27851 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ecb6b40fa694f298b65e31bea41e5b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:41 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:58262
I20260806 10:41:41.243656 28030 tablet_replica.cc:330] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78: stopping tablet replica
I20260806 10:41:41.243710 27412 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ecb6b40fa694f298b65e31bea41e5b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:41 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:53320
I20260806 10:41:41.244187 28030 raft_consensus.cc:2229] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:41:41.245066 28030 raft_consensus.cc:2258] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:41.246546 27641 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ecb6b40fa694f298b65e31bea41e5b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:41 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:34354
I20260806 10:41:41.247363 28033 tablet_replica.cc:330] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209: stopping tablet replica
I20260806 10:41:41.247951 28033 raft_consensus.cc:2229] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:41.249063 28033 raft_consensus.cc:2258] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:41.251896 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 26023
I20260806 10:41:41.252983 26110 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:41.254119 28033 ts_tablet_manager.cc:1905] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:41.260070 28030 ts_tablet_manager.cc:1905] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:41.265102 28035 tablet_replica.cc:330] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e: stopping tablet replica
I20260806 10:41:41.265727 28035 raft_consensus.cc:2229] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:41.266580 28035 raft_consensus.cc:2258] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:41.269057 28035 ts_tablet_manager.cc:1905] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:41.278919 28035 ts_tablet_manager.cc:1918] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:41.279325 28035 log.cc:1196] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/7ecb6b40fa694f298b65e31bea41e5b8
I20260806 10:41:41.279719 28033 ts_tablet_manager.cc:1918] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:41.280006 28033 log.cc:1196] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/7ecb6b40fa694f298b65e31bea41e5b8
I20260806 10:41:41.280735 28035 ts_tablet_manager.cc:1939] T 7ecb6b40fa694f298b65e31bea41e5b8 P 4399de29d9e74ea3a18f8f563cc4f62e: Deleting consensus metadata
I20260806 10:41:41.281004 28033 ts_tablet_manager.cc:1939] T 7ecb6b40fa694f298b65e31bea41e5b8 P 63364df350a640d0864f873f77a07209: Deleting consensus metadata
I20260806 10:41:41.288060 28030 ts_tablet_manager.cc:1918] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:41.288466 28030 log.cc:1196] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/7ecb6b40fa694f298b65e31bea41e5b8
I20260806 10:41:41.289459 28030 ts_tablet_manager.cc:1939] T 7ecb6b40fa694f298b65e31bea41e5b8 P 48df401686594af9a76e6559fa33de78: Deleting consensus metadata
I20260806 10:41:41.294862 27971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:41.246675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58458 (local address 127.16.45.125:40553)
0806 10:41:41.246849 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:41.246855 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:41.250792 (+ 3937us) server_negotiation.cc:407] Connection header received
0806 10:41:41.258267 (+ 7475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:41.258274 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:41.258401 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:41.258505 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:41.264172 (+ 5667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.265267 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.271787 (+ 6520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.272783 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.272899 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:41.284580 (+ 11681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:41.284589 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:41.284593 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:41.284674 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:41.290673 (+ 5999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:41.292160 (+ 1487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:41.292166 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:41.292169 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:41.292424 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:41.292884 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:41.292889 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:41.292892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:41.293392 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:41.293782 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:41.294039 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 10:41:41.294351 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 10:41:41.323572 27961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:41.250478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56826 (local address 127.16.45.124:45433)
0806 10:41:41.250682 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:41.250688 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:41.294829 (+ 44141us) server_negotiation.cc:407] Connection header received
0806 10:41:41.294907 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:41.294912 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:41.294998 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:41.295096 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:41.297854 (+ 2758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.299303 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.301886 (+ 2583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.302911 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.303010 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:41.308403 (+ 5393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:41.308411 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:41.308417 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:41.308464 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:41.319687 (+ 11223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:41.320610 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:41.320617 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:41.320621 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:41.320796 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:41.321251 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:41.321256 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:41.321260 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:41.321605 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:41.321925 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:41.322716 (+ 791us) server_negotiation.cc:299] Negotiation successful
0806 10:41:41.323016 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 10:41:41.465695 26050 catalog_manager.cc:4841] TS 63364df350a640d0864f873f77a07209 (127.16.45.65:34031): tablet 7ecb6b40fa694f298b65e31bea41e5b8 (table test-table [id=a7aa0671012f4e8aa0b02a5ccfcf56db]) successfully deleted
I20260806 10:41:41.466769 26048 catalog_manager.cc:4841] TS 48df401686594af9a76e6559fa33de78 (127.16.45.67:41305): tablet 7ecb6b40fa694f298b65e31bea41e5b8 (table test-table [id=a7aa0671012f4e8aa0b02a5ccfcf56db]) successfully deleted
I20260806 10:41:41.467337 26048 catalog_manager.cc:4841] TS 4399de29d9e74ea3a18f8f563cc4f62e (127.16.45.66:38487): tablet 7ecb6b40fa694f298b65e31bea41e5b8 (table test-table [id=a7aa0671012f4e8aa0b02a5ccfcf56db]) successfully deleted
I20260806 10:41:41.467963 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 26023
I20260806 10:41:41.533826 27971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:41.517155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58470 (local address 127.16.45.125:40553)
0806 10:41:41.517391 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:41.517397 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:41.517695 (+ 298us) server_negotiation.cc:407] Connection header received
0806 10:41:41.517875 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:41.517880 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:41.517958 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:41.518052 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:41.520360 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.521502 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.523657 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.524313 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.524433 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:41.527470 (+ 3037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:41.527476 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:41.527481 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:41.527536 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:41.531033 (+ 3497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:41.531809 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:41.531815 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:41.531818 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:41.531999 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:41.532483 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:41.532488 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:41.532491 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:41.532796 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:41.533049 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:41.533348 (+ 299us) server_negotiation.cc:299] Negotiation successful
0806 10:41:41.533519 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 10:41:41.534814 27961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:41.500280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56830 (local address 127.16.45.124:45433)
0806 10:41:41.500507 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:41.500514 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:41.515530 (+ 15016us) server_negotiation.cc:407] Connection header received
0806 10:41:41.515848 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:41.515855 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:41.515966 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:41.516045 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:41.518792 (+ 2747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.519934 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.521938 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:41.522625 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:41.522724 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:41.527521 (+ 4797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:41.527528 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:41.527532 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:41.527572 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:41.530917 (+ 3345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:41.531876 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:41.531882 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:41.531886 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:41.532026 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:41.532419 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:41.532425 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:41.532428 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:41.532796 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:41.533050 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:41.534206 (+ 1156us) server_negotiation.cc:299] Negotiation successful
0806 10:41:41.534476 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260806 10:41:42.222800 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.221303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.65:39129)
0806 10:41:42.222425 (+ 1122us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.222578 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":933,"thread_start_us":822,"threads_started":1}
W20260806 10:41:42.223543 27519 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:34899 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
I20260806 10:41:42.224457 28046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.223646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.67:48647)
0806 10:41:42.224136 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.224270 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":277,"threads_started":1}
W20260806 10:41:42.224785 27945 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:34899 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
I20260806 10:41:42.230659 28047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.229833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.66:50567)
0806 10:41:42.230336 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.230462 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":204,"threads_started":1}
W20260806 10:41:42.231051 27730 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:34899 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
I20260806 10:41:42.740711 28048 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fdde3c17390c427e9af52c8cbc0f512b)
I20260806 10:41:42.741012 28048 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } }
I20260806 10:41:42.741995 28049 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fdde3c17390c427e9af52c8cbc0f512b)
I20260806 10:41:42.742218 28049 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } }
I20260806 10:41:42.742475 28048 leader_election.cc:288] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fdde3c17390c427e9af52c8cbc0f512b (127.16.45.126:34899), 7801bc445429445198295507aa9e724b (127.16.45.125:40553)
I20260806 10:41:42.743599 28050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.742630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54808)
0806 10:41:42.743121 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.743294 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":217,"threads_started":1}
I20260806 10:41:42.745131 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.743787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54814)
0806 10:41:42.744658 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.744857 (+ 199us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":537,"threads_started":1}
W20260806 10:41:42.745496 26939 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
W20260806 10:41:42.752970 27230 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
I20260806 10:41:42.762261 28049 leader_election.cc:288] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fdde3c17390c427e9af52c8cbc0f512b (127.16.45.126:34899), 6214f668e6f34f619c4e5216f1827f58 (127.16.45.124:45433)
I20260806 10:41:42.764108 28059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.751154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54830)
0806 10:41:42.763591 (+ 12437us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.763800 (+ 209us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12292,"threads_started":1}
W20260806 10:41:42.764557 26939 leader_election.cc:334] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fdde3c17390c427e9af52c8cbc0f512b (127.16.45.126:34899): Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
I20260806 10:41:42.766420 28050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.743276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:40553 (local address 127.0.0.1:58476)
0806 10:41:42.743921 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.743947 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:42.744107 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:42.759333 (+ 15226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:42.759339 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:42.759398 (+ 59us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:42.759692 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:42.759707 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.761768 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.761776 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:42.763926 (+ 2150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:42.763946 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.765576 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.765583 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:42.765790 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:42.765828 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 10:41:42.765917 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 10:41:42.766066 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":9351,"threads_started":1}
I20260806 10:41:42.766502 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.765906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54836)
0806 10:41:42.766087 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.766281 (+ 194us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 10:41:42.766784 27230 leader_election.cc:334] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fdde3c17390c427e9af52c8cbc0f512b (127.16.45.126:34899): Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
I20260806 10:41:42.767658 28052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.743356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58476 (local address 127.16.45.125:40553)
0806 10:41:42.758885 (+ 15529us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:42.758892 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:42.758913 (+ 21us) server_negotiation.cc:407] Connection header received
0806 10:41:42.758983 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:42.758989 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:42.759063 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:42.759964 (+ 901us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:42.760195 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.761569 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.764148 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.765354 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.767094 (+ 1740us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:42.767190 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:42.767242 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 10:41:42.767341 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15383,"thread_start_us":15783,"threads_started":1}
I20260806 10:41:42.768440 26988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6214f668e6f34f619c4e5216f1827f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7801bc445429445198295507aa9e724b" is_pre_election: true
I20260806 10:41:42.768867 26988 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6214f668e6f34f619c4e5216f1827f58 in term 1.
I20260806 10:41:42.770146 27230 leader_election.cc:302] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6214f668e6f34f619c4e5216f1827f58, 7801bc445429445198295507aa9e724b; no voters: fdde3c17390c427e9af52c8cbc0f512b
I20260806 10:41:42.770514 28048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 10:41:42.770653 28048 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fdde3c17390c427e9af52c8cbc0f512b)
I20260806 10:41:42.770758 28048 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 1 FOLLOWER]: Advancing to term 2
I20260806 10:41:42.772684 28053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.744908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:45433 (local address 127.0.0.1:56836)
0806 10:41:42.756924 (+ 12016us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.756947 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:42.757110 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:42.766110 (+ 9000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:42.766116 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:42.766150 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:42.766467 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:42.766478 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.768661 (+ 2183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.768666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:42.770337 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:42.770352 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.771994 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.772001 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:42.772202 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:42.772238 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 10:41:42.772318 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 10:41:42.772422 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11897,"thread_start_us":24449,"threads_started":1}
I20260806 10:41:42.772907 28057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.745367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56836 (local address 127.16.45.124:45433)
0806 10:41:42.765722 (+ 20355us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:42.765730 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:42.765752 (+ 22us) server_negotiation.cc:407] Connection header received
0806 10:41:42.765817 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:42.765833 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:42.765926 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:42.766613 (+ 687us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:42.766935 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.768199 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.770519 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.771750 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.771951 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:42.772075 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:42.772394 (+ 319us) server_negotiation.cc:299] Negotiation successful
0806 10:41:42.772544 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20209,"thread_start_us":20056,"threads_started":1}
I20260806 10:41:42.773631 27260 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7801bc445429445198295507aa9e724b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6214f668e6f34f619c4e5216f1827f58" is_pre_election: true
I20260806 10:41:42.773892 28048 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } }
I20260806 10:41:42.774425 27260 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7801bc445429445198295507aa9e724b in current term 2: Already voted for candidate 6214f668e6f34f619c4e5216f1827f58 in this term.
I20260806 10:41:42.774547 28048 leader_election.cc:288] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [CANDIDATE]: Term 2 election: Requested vote from peers fdde3c17390c427e9af52c8cbc0f512b (127.16.45.126:34899), 7801bc445429445198295507aa9e724b (127.16.45.125:40553)
I20260806 10:41:42.775051 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.774708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54860)
0806 10:41:42.774850 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.774935 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 10:41:42.775238 26988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6214f668e6f34f619c4e5216f1827f58" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7801bc445429445198295507aa9e724b"
I20260806 10:41:42.775508 26937 leader_election.cc:302] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7801bc445429445198295507aa9e724b; no voters: 6214f668e6f34f619c4e5216f1827f58, fdde3c17390c427e9af52c8cbc0f512b
I20260806 10:41:42.775568 26988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 1 FOLLOWER]: Advancing to term 2
I20260806 10:41:42.776029 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.775693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54872)
0806 10:41:42.775816 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.775893 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260806 10:41:42.776268 27230 leader_election.cc:334] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fdde3c17390c427e9af52c8cbc0f512b (127.16.45.126:34899): Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
I20260806 10:41:42.777819 26988 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6214f668e6f34f619c4e5216f1827f58 in term 2.
I20260806 10:41:42.778021 28049 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 10:41:42.778216 27230 leader_election.cc:302] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6214f668e6f34f619c4e5216f1827f58, 7801bc445429445198295507aa9e724b; no voters: fdde3c17390c427e9af52c8cbc0f512b
I20260806 10:41:42.778542 28048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 10:41:42.778985 28048 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [term 2 LEADER]: Becoming Leader. State: Replica: 6214f668e6f34f619c4e5216f1827f58, State: Running, Role: LEADER
I20260806 10:41:42.779336 28048 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } }
I20260806 10:41:42.781209 28061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6214f668e6f34f619c4e5216f1827f58. Latest consensus state: current_term: 2 leader_uuid: "6214f668e6f34f619c4e5216f1827f58" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } } }
I20260806 10:41:42.781548 28061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:42.782222 28066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:42.786095 28066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:42.786959 28066 catalog_manager.cc:1259] Loaded cluster ID: 80b420ac56fe4c57bfde83b973b27a4a
I20260806 10:41:42.787037 28066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:42.788149 28066 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:42.788928 28066 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: Loaded TSK: 0
I20260806 10:41:42.789736 28066 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:41:42.826833 27246 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56830:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:41:42.833890 27246 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:42.837994 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.837603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54892)
0806 10:41:42.837754 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.837840 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 10:41:42.838471 26988 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [term 2 FOLLOWER]: Refusing update from remote peer 6214f668e6f34f619c4e5216f1827f58: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260806 10:41:42.839083 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.838706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54902)
0806 10:41:42.838848 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.838934 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 10:41:42.839386 28061 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260806 10:41:42.839676 27230 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 -> Peer fdde3c17390c427e9af52c8cbc0f512b (127.16.45.126:34899): Couldn't send request to peer fdde3c17390c427e9af52c8cbc0f512b. Status: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 10:41:42.842157 28049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6214f668e6f34f619c4e5216f1827f58. Latest consensus state: current_term: 2 leader_uuid: "6214f668e6f34f619c4e5216f1827f58" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } } }
I20260806 10:41:42.842445 28049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:41:42.844154 28048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "6214f668e6f34f619c4e5216f1827f58" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } } }
I20260806 10:41:42.844509 28048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:42.844672 28049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "6214f668e6f34f619c4e5216f1827f58" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fdde3c17390c427e9af52c8cbc0f512b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 34899 } } peers { permanent_uuid: "7801bc445429445198295507aa9e724b" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 40553 } attrs { promote: false } } peers { permanent_uuid: "6214f668e6f34f619c4e5216f1827f58" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 45433 } attrs { promote: false } } }
I20260806 10:41:42.844940 28049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7801bc445429445198295507aa9e724b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:41:42.860486 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.851948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:38487 (local address 127.0.0.1:34356)
0806 10:41:42.852093 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.852118 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:42.852224 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:42.853296 (+ 1072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:42.853301 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:42.853327 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:42.853890 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:42.853901 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.855423 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.855430 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:42.857770 (+ 2340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:42.857787 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.859607 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.859614 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:42.859825 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:42.859866 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 10:41:42.859937 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 10:41:42.860092 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":227}
I20260806 10:41:42.861184 28050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.852263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:41305 (local address 127.0.0.1:58278)
0806 10:41:42.852724 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.852752 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:42.852849 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:42.853175 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:42.853179 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:42.853226 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:42.853477 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:42.853490 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.855898 (+ 2408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.855904 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:42.858000 (+ 2096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:42.858017 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.859750 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.859757 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:42.860072 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:42.860111 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 10:41:42.860200 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 10:41:42.860362 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":3}
I20260806 10:41:42.861593 28079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.852454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58278 (local address 127.16.45.67:41305)
0806 10:41:42.852869 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:42.852873 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:42.852891 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:41:42.852949 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:42.852953 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:42.853019 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:42.854069 (+ 1050us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:42.854292 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.855727 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.858236 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.859560 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.860603 (+ 1043us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:42.860913 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:42.860970 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 10:41:42.861125 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":220,"threads_started":1}
I20260806 10:41:42.862049 28080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.852467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34356 (local address 127.16.45.66:38487)
0806 10:41:42.852890 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:42.852896 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:42.852915 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:41:42.852989 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:42.852994 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:42.853095 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:42.853393 (+ 298us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:42.854025 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.855256 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.858047 (+ 2791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.859346 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.861435 (+ 2089us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:42.861559 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:42.861615 (+ 56us) server_negotiation.cc:299] Negotiation successful
0806 10:41:42.861756 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":817,"threads_started":1}
I20260806 10:41:42.862473 27851 tablet_service.cc:1467] Processing CreateTablet for tablet db31f02174f84185aa1af0d9fd9ed846 (DEFAULT_TABLE table=test-table [id=7b4eb6ed2999413ba27bee772de49df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:42.862823 27641 tablet_service.cc:1467] Processing CreateTablet for tablet db31f02174f84185aa1af0d9fd9ed846 (DEFAULT_TABLE table=test-table [id=7b4eb6ed2999413ba27bee772de49df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:42.862995 27851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db31f02174f84185aa1af0d9fd9ed846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:42.863313 27641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db31f02174f84185aa1af0d9fd9ed846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:42.869638 28085 tablet_bootstrap.cc:492] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e: Bootstrap starting.
I20260806 10:41:42.870474 28086 tablet_bootstrap.cc:492] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78: Bootstrap starting.
I20260806 10:41:42.872406 28086 tablet_bootstrap.cc:654] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:42.872650 28085 tablet_bootstrap.cc:654] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:42.874796 28086 tablet_bootstrap.cc:492] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78: No bootstrap required, opened a new log
I20260806 10:41:42.874930 28086 ts_tablet_manager.cc:1397] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 10:41:42.875519 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.853137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:34031 (local address 127.0.0.1:53324)
0806 10:41:42.860753 (+ 7616us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.860771 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:42.860863 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:42.870398 (+ 9535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:42.870403 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:42.870454 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:42.870675 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:42.870689 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.871971 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.871977 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:42.873412 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:42.873428 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.874812 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.874817 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:42.874992 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:42.875030 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 10:41:42.875092 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 10:41:42.875198 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7532,"thread_start_us":11433,"threads_started":1}
I20260806 10:41:42.875771 28086 raft_consensus.cc:348] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } } peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } }
I20260806 10:41:42.876024 28086 raft_consensus.cc:374] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:42.876113 28086 raft_consensus.cc:729] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48df401686594af9a76e6559fa33de78, State: Initialized, Role: FOLLOWER
I20260806 10:41:42.876307 28082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.853275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53324 (local address 127.16.45.65:34031)
0806 10:41:42.869920 (+ 16645us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:42.869926 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:42.869947 (+ 21us) server_negotiation.cc:407] Connection header received
0806 10:41:42.870033 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:42.870039 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:42.870121 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:42.870795 (+ 674us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:42.870956 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.871841 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.873612 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.874633 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.875730 (+ 1097us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:42.875841 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:42.875892 (+ 51us) server_negotiation.cc:299] Negotiation successful
0806 10:41:42.875996 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16488,"thread_start_us":16928,"threads_started":1}
I20260806 10:41:42.876384 28086 consensus_queue.cc:260] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } } peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } }
I20260806 10:41:42.876937 27412 tablet_service.cc:1467] Processing CreateTablet for tablet db31f02174f84185aa1af0d9fd9ed846 (DEFAULT_TABLE table=test-table [id=7b4eb6ed2999413ba27bee772de49df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:42.877308 27412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db31f02174f84185aa1af0d9fd9ed846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:42.881381 28086 ts_tablet_manager.cc:1428] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 10:41:42.881737 28085 tablet_bootstrap.cc:492] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e: No bootstrap required, opened a new log
I20260806 10:41:42.881947 28085 ts_tablet_manager.cc:1397] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260806 10:41:42.882861 28085 raft_consensus.cc:348] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } } peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } }
I20260806 10:41:42.883183 28085 raft_consensus.cc:374] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:42.883317 28085 raft_consensus.cc:729] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4399de29d9e74ea3a18f8f563cc4f62e, State: Initialized, Role: FOLLOWER
I20260806 10:41:42.883651 28085 consensus_queue.cc:260] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } } peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } }
I20260806 10:41:42.884698 27944 heartbeater.cc:503] Master 127.16.45.124:45433 was elected leader, sending a full tablet report...
I20260806 10:41:42.891280 28091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.881979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.67:40783)
0806 10:41:42.890804 (+ 8825us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.891016 (+ 212us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8689,"thread_start_us":8548,"threads_started":1}
I20260806 10:41:42.891937 28085 ts_tablet_manager.cc:1428] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e: Time spent starting tablet: real 0.010s user 0.002s sys 0.006s
I20260806 10:41:42.892293 28092 tablet_bootstrap.cc:492] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209: Bootstrap starting.
I20260806 10:41:42.893994 28091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.893540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.67:54723)
0806 10:41:42.893763 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.893852 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260806 10:41:42.896005 27729 heartbeater.cc:503] Master 127.16.45.124:45433 was elected leader, sending a full tablet report...
I20260806 10:41:42.896150 28092 tablet_bootstrap.cc:654] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:42.897521 28095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.892642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.66:54933)
0806 10:41:42.895903 (+ 3261us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.896636 (+ 733us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3121,"thread_start_us":2982,"threads_started":1}
I20260806 10:41:42.898593 28092 tablet_bootstrap.cc:492] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209: No bootstrap required, opened a new log
I20260806 10:41:42.898769 28092 ts_tablet_manager.cc:1397] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260806 10:41:42.898914 28095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.898564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.66:48685)
0806 10:41:42.898702 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.898779 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 10:41:42.899436 28092 raft_consensus.cc:348] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } } peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } }
I20260806 10:41:42.899605 28092 raft_consensus.cc:374] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:42.899668 28092 raft_consensus.cc:729] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63364df350a640d0864f873f77a07209, State: Initialized, Role: FOLLOWER
I20260806 10:41:42.899855 28092 consensus_queue.cc:260] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } } peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } }
I20260806 10:41:42.900507 28092 ts_tablet_manager.cc:1428] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 10:41:42.901662 28101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.900796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.65:37049)
0806 10:41:42.901296 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.901462 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":245,"threads_started":1}
I20260806 10:41:42.902406 27515 heartbeater.cc:503] Master 127.16.45.124:45433 was elected leader, sending a full tablet report...
I20260806 10:41:42.902652 28101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.902226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.65:53807)
0806 10:41:42.902394 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.902491 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 10:41:42.913879 28090 raft_consensus.cc:482] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:42.914098 28090 raft_consensus.cc:504] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } } peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } }
I20260806 10:41:42.914880 28090 leader_election.cc:288] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4399de29d9e74ea3a18f8f563cc4f62e (127.16.45.66:38487), 63364df350a640d0864f873f77a07209 (127.16.45.65:34031)
I20260806 10:41:42.915362 27442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db31f02174f84185aa1af0d9fd9ed846" candidate_uuid: "48df401686594af9a76e6559fa33de78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63364df350a640d0864f873f77a07209" is_pre_election: true
I20260806 10:41:42.915364 27667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db31f02174f84185aa1af0d9fd9ed846" candidate_uuid: "48df401686594af9a76e6559fa33de78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" is_pre_election: true
I20260806 10:41:42.915572 27442 raft_consensus.cc:2454] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48df401686594af9a76e6559fa33de78 in term 0.
I20260806 10:41:42.915606 27667 raft_consensus.cc:2454] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48df401686594af9a76e6559fa33de78 in term 0.
I20260806 10:41:42.916002 27788 leader_election.cc:302] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48df401686594af9a76e6559fa33de78, 63364df350a640d0864f873f77a07209; no voters:
I20260806 10:41:42.916285 28090 raft_consensus.cc:2781] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:42.916409 28090 raft_consensus.cc:482] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:42.916497 28090 raft_consensus.cc:3037] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:42.918648 28090 raft_consensus.cc:504] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } } peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } }
I20260806 10:41:42.919163 28090 leader_election.cc:288] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [CANDIDATE]: Term 1 election: Requested vote from peers 4399de29d9e74ea3a18f8f563cc4f62e (127.16.45.66:38487), 63364df350a640d0864f873f77a07209 (127.16.45.65:34031)
I20260806 10:41:42.919631 27667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db31f02174f84185aa1af0d9fd9ed846" candidate_uuid: "48df401686594af9a76e6559fa33de78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4399de29d9e74ea3a18f8f563cc4f62e"
I20260806 10:41:42.919672 27442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db31f02174f84185aa1af0d9fd9ed846" candidate_uuid: "48df401686594af9a76e6559fa33de78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63364df350a640d0864f873f77a07209"
I20260806 10:41:42.919857 27442 raft_consensus.cc:3037] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:42.919848 27667 raft_consensus.cc:3037] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:42.922781 27667 raft_consensus.cc:2454] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48df401686594af9a76e6559fa33de78 in term 1.
I20260806 10:41:42.922806 27442 raft_consensus.cc:2454] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48df401686594af9a76e6559fa33de78 in term 1.
I20260806 10:41:42.923147 27784 leader_election.cc:302] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4399de29d9e74ea3a18f8f563cc4f62e, 48df401686594af9a76e6559fa33de78; no voters:
I20260806 10:41:42.923513 28090 raft_consensus.cc:2781] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:42.923986 28090 raft_consensus.cc:686] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 1 LEADER]: Becoming Leader. State: Replica: 48df401686594af9a76e6559fa33de78, State: Running, Role: LEADER
I20260806 10:41:42.924292 28090 consensus_queue.cc:237] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } } peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } }
I20260806 10:41:42.925505 28091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.925038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.67:50209)
0806 10:41:42.925221 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.925342 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 10:41:42.928094 27246 catalog_manager.cc:5495] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48df401686594af9a76e6559fa33de78 (127.16.45.67). New cstate: current_term: 1 leader_uuid: "48df401686594af9a76e6559fa33de78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48df401686594af9a76e6559fa33de78" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 } health_report { overall_health: UNKNOWN } } }
I20260806 10:41:42.954620 28079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.950102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58286 (local address 127.16.45.67:41305)
0806 10:41:42.950307 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:42.950349 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:42.950371 (+ 22us) server_negotiation.cc:407] Connection header received
0806 10:41:42.950583 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:42.950588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:42.950666 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:42.950744 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:42.951080 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.951793 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.953023 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:42.953448 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:42.953555 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:42.953933 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:42.954031 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:42.954104 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:42.954244 (+ 140us) server_negotiation.cc:299] Negotiation successful
0806 10:41:42.954352 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 10:41:42.957682 27667 raft_consensus.cc:1261] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e [term 1 FOLLOWER]: Refusing update from remote peer 48df401686594af9a76e6559fa33de78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:42.957685 27442 raft_consensus.cc:1261] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209 [term 1 FOLLOWER]: Refusing update from remote peer 48df401686594af9a76e6559fa33de78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:42.958334 28102 consensus_queue.cc:1035] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63364df350a640d0864f873f77a07209" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:42.958714 28090 consensus_queue.cc:1035] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4399de29d9e74ea3a18f8f563cc4f62e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:42.961105 28095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.960545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.66:39167)
0806 10:41:42.960727 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.960856 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 10:41:42.961653 28101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.961065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.65:47165)
0806 10:41:42.961302 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.961428 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260806 10:41:42.969167 28101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.968697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.65:35453)
0806 10:41:42.968917 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.969009 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260806 10:41:42.971143 28091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.970028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.67:58163)
0806 10:41:42.970861 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.970964 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":707}
I20260806 10:41:42.975530 28091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.974380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.67:36687)
0806 10:41:42.975248 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.975342 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":758}
I20260806 10:41:42.976620 28095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:42.976159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.16.45.66:47929)
0806 10:41:42.976371 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:42.976460 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260806 10:41:42.980121 27246 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:42.980419 27246 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:42.991004 27246 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6214f668e6f34f619c4e5216f1827f58: Sending DeleteTablet for 3 replicas of tablet db31f02174f84185aa1af0d9fd9ed846
I20260806 10:41:42.992034 27412 tablet_service.cc:1514] Processing DeleteTablet for tablet db31f02174f84185aa1af0d9fd9ed846 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:42 UTC) from {username='oryx', principal='oryx/127.16.45.124@KRBTEST.COM'} at 127.0.0.1:53324
I20260806 10:41:42.992074 27641 tablet_service.cc:1514] Processing DeleteTablet for tablet db31f02174f84185aa1af0d9fd9ed846 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:42 UTC) from {username='oryx', principal='oryx/127.16.45.124@KRBTEST.COM'} at 127.0.0.1:34356
I20260806 10:41:42.992496 27640 tablet_service.cc:1514] Processing DeleteTablet for tablet db31f02174f84185aa1af0d9fd9ed846 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:42 UTC) from {username='oryx', principal='oryx/127.16.45.124@KRBTEST.COM'} at 127.0.0.1:34356
I20260806 10:41:42.992838 27851 tablet_service.cc:1514] Processing DeleteTablet for tablet db31f02174f84185aa1af0d9fd9ed846 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:42 UTC) from {username='oryx', principal='oryx/127.16.45.124@KRBTEST.COM'} at 127.0.0.1:58278
I20260806 10:41:42.999828 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 27211
I20260806 10:41:43.006147 28122 tablet_replica.cc:330] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78: stopping tablet replica
I20260806 10:41:43.006551 28122 raft_consensus.cc:2229] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:41:43.006995 28122 raft_consensus.cc:2258] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:43.008198 28120 tablet_replica.cc:330] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e: stopping tablet replica
I20260806 10:41:43.008420 28120 raft_consensus.cc:2229] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:43.008755 28120 raft_consensus.cc:2258] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:43.009248 28122 ts_tablet_manager.cc:1905] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:43.009337 28121 tablet_replica.cc:330] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209: stopping tablet replica
I20260806 10:41:43.009547 28121 raft_consensus.cc:2229] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:43.009837 28121 raft_consensus.cc:2258] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:43.010986 28121 ts_tablet_manager.cc:1905] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:43.010988 28120 ts_tablet_manager.cc:1905] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:43.015796 28122 ts_tablet_manager.cc:1918] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:43.015949 28122 log.cc:1196] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/db31f02174f84185aa1af0d9fd9ed846
I20260806 10:41:43.016391 28122 ts_tablet_manager.cc:1939] T db31f02174f84185aa1af0d9fd9ed846 P 48df401686594af9a76e6559fa33de78: Deleting consensus metadata
I20260806 10:41:43.017380 28120 ts_tablet_manager.cc:1918] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:43.017530 28120 log.cc:1196] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/db31f02174f84185aa1af0d9fd9ed846
I20260806 10:41:43.017699 27227 catalog_manager.cc:4841] TS 48df401686594af9a76e6559fa33de78 (127.16.45.67:41305): tablet db31f02174f84185aa1af0d9fd9ed846 (table test-table [id=7b4eb6ed2999413ba27bee772de49df2]) successfully deleted
I20260806 10:41:43.018013 28120 ts_tablet_manager.cc:1939] T db31f02174f84185aa1af0d9fd9ed846 P 4399de29d9e74ea3a18f8f563cc4f62e: Deleting consensus metadata
I20260806 10:41:43.018143 28121 ts_tablet_manager.cc:1918] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:43.018383 28121 log.cc:1196] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/db31f02174f84185aa1af0d9fd9ed846
I20260806 10:41:43.018857 28121 ts_tablet_manager.cc:1939] T db31f02174f84185aa1af0d9fd9ed846 P 63364df350a640d0864f873f77a07209: Deleting consensus metadata
I20260806 10:41:43.019037 28082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:43.001206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53340 (local address 127.16.45.65:34031)
0806 10:41:43.001450 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:43.001457 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:43.001478 (+ 21us) server_negotiation.cc:407] Connection header received
0806 10:41:43.001549 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:43.001555 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:43.001647 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:43.001760 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:43.003616 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:43.004783 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:43.006646 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:43.007282 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:43.007413 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:43.011183 (+ 3770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:43.011201 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:43.011220 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:43.011261 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:43.015262 (+ 4001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:43.016169 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:43.016179 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:43.016183 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:43.016377 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:43.016816 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:43.016821 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:43.016823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:43.017332 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:43.017652 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:43.018366 (+ 714us) server_negotiation.cc:299] Negotiation successful
0806 10:41:43.018633 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:41:43.019109 27227 catalog_manager.cc:4841] TS 4399de29d9e74ea3a18f8f563cc4f62e (127.16.45.66:38487): tablet db31f02174f84185aa1af0d9fd9ed846 (table test-table [id=7b4eb6ed2999413ba27bee772de49df2]) successfully deleted
W20260806 10:41:43.019855 27227 catalog_manager.cc:4808] TS 4399de29d9e74ea3a18f8f563cc4f62e (127.16.45.66:38487): delete failed for tablet db31f02174f84185aa1af0d9fd9ed846 because the tablet was not found. No further retry: Not found: Tablet not found: db31f02174f84185aa1af0d9fd9ed846
I20260806 10:41:43.019953 27507 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:43.019909 27230 catalog_manager.cc:4841] TS 63364df350a640d0864f873f77a07209 (127.16.45.65:34031): tablet db31f02174f84185aa1af0d9fd9ed846 (table test-table [id=7b4eb6ed2999413ba27bee772de49df2]) successfully deleted
I20260806 10:41:43.112520 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 27211
I20260806 10:41:43.135684 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 27537
I20260806 10:41:43.150286 28080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:43.136544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34358 (local address 127.16.45.66:38487)
0806 10:41:43.136722 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:43.136727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:43.136745 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:41:43.136908 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:43.136912 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:43.136986 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:43.137063 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:43.138752 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:43.139528 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:43.141388 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:43.141832 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:43.141948 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:43.145259 (+ 3311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:43.145273 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:43.145290 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:43.145326 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:43.148093 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:43.148681 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:43.148688 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:43.148690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:43.148810 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:43.149098 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:43.149100 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:43.149102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:43.149462 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:43.149686 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:43.149884 (+ 198us) server_negotiation.cc:299] Negotiation successful
0806 10:41:43.150048 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 10:41:43.151052 27724 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:43.244829 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 27537
I20260806 10:41:43.266044 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 27757
I20260806 10:41:43.279872 28079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:43.266919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58298 (local address 127.16.45.67:41305)
0806 10:41:43.267103 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:43.267109 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:43.267129 (+ 20us) server_negotiation.cc:407] Connection header received
0806 10:41:43.267449 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:43.267464 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:43.267543 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:43.267656 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:43.269175 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:43.269928 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:43.271252 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:43.271649 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:43.271758 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:43.274363 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:43.274382 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:43.274401 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:43.274435 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:43.277076 (+ 2641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:43.277725 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:43.277735 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:43.277738 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:43.277876 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:43.278249 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:43.278254 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:43.278267 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:43.278742 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:43.279039 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:43.279323 (+ 284us) server_negotiation.cc:299] Negotiation successful
0806 10:41:43.279540 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:41:43.280480 27938 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:43.283142 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:43.282720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54918)
0806 10:41:43.282881 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:43.282978 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 10:41:43.284238 28051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:43.283814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:34899 (local address 127.0.0.1:54928)
0806 10:41:43.284009 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:43.284084 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:34899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260806 10:41:43.402181 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 27757
I20260806 10:41:43.429596 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 26765
I20260806 10:41:43.430692 27012 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:43.546520 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 26765
I20260806 10:41:43.572216 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 26905
I20260806 10:41:43.573318 27293 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:43.692988 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 26905
2026-08-06T10:41:43Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10090 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:41:43 dist-test-slave-fgb3 krb5kdc[28136](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:41:43 dist-test-slave-fgb3 krb5kdc[28136](info): set up 2 sockets
Aug 06 10:41:43 dist-test-slave-fgb3 krb5kdc[28136](info): commencing operation
krb5kdc: starting...
W20260806 10:41:44.964999 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:41:45 dist-test-slave-fgb3 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:41:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:45Z Disabled control of system clock
WARNING: no policy specified for oryx/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.126.keytab.
Entry for principal oryx/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.126.keytab.
I20260806 10:41:45.416575 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:37983
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.126.keytab
--principal=oryx/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:32845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:37983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:46.092629 28154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:46.093164 28154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:46.093405 28154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:46.105249 28154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:46.105427 28154 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 10:41:46.105574 28154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:46.105727 28154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:46.105855 28154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:46.106019 28154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:46.123099 28154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:32845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:37983
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.126.keytab
--principal=oryx/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:37983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:46.125376 28154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:46.127759 28154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:46.148022 28164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:46.147920 28163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:46.148132 28168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:46.149343 28154 server_base.cc:1034] running on GCE node
I20260806 10:41:46.150791 28154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:46.153328 28154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:46.154670 28154 hybrid_clock.cc:648] HybridClock initialized: now 1786012906154550 us; error 49 us; skew 500 ppm
I20260806 10:41:46.155210 28154 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:46 dist-test-slave-fgb3 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012906, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:46.160967 28154 init.cc:377] Logged in from keytab as oryx/127.16.45.126@KRBTEST.COM (short username oryx)
I20260806 10:41:46.163749 28154 webserver.cc:460] Webserver started at http://127.16.45.126:44251/ using document root <none> and password file <none>
I20260806 10:41:46.165004 28154 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:46.165199 28154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:46.165794 28154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:46.172909 28154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "ecddba99efa54ca8bbcb997598167b3c"
format_stamp: "Formatted at 2026-08-06 10:41:46 on dist-test-slave-fgb3"
server_key: "bddf01adcb5eb3ab5d0df32fa5fdc3ca"
server_key_iv: "a9288f4d6d7f9606791b0fe313307e30"
server_key_version: "encryptionkey@0"
I20260806 10:41:46.174521 28154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "ecddba99efa54ca8bbcb997598167b3c"
format_stamp: "Formatted at 2026-08-06 10:41:46 on dist-test-slave-fgb3"
server_key: "bddf01adcb5eb3ab5d0df32fa5fdc3ca"
server_key_iv: "a9288f4d6d7f9606791b0fe313307e30"
server_key_version: "encryptionkey@0"
I20260806 10:41:46.184199 28154 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.003s sys 0.005s
I20260806 10:41:46.190670 28179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:46.192921 28154 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.002s
I20260806 10:41:46.193203 28154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "ecddba99efa54ca8bbcb997598167b3c"
format_stamp: "Formatted at 2026-08-06 10:41:46 on dist-test-slave-fgb3"
server_key: "bddf01adcb5eb3ab5d0df32fa5fdc3ca"
server_key_iv: "a9288f4d6d7f9606791b0fe313307e30"
server_key_version: "encryptionkey@0"
I20260806 10:41:46.193567 28154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:46.225620 28154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:46.233246 28154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:46.233714 28154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:46.267494 28154 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:37983
I20260806 10:41:46.267544 28271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:37983 every 8 connection(s)
I20260806 10:41:46.269789 28154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:46.276013 28272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:46.278661 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 28154
I20260806 10:41:46.279011 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:46.280186 16565 external_mini_cluster.cc:1428] Setting key 97f52b87e17499817727d9058fd7e9e0
I20260806 10:41:46.299531 28272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c: Bootstrap starting.
I20260806 10:41:46.305922 28272 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:46.307667 28272 log.cc:824] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c: Log is configured to *not* fsync() on all Append() calls
Aug 06 10:41:46 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012905, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
I20260806 10:41:46.313714 28272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c: No bootstrap required, opened a new log
I20260806 10:41:46.325788 28277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:46.284321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48572 (local address 127.16.45.126:37983)
0806 10:41:46.285862 (+ 1541us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:46.285898 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:46.286000 (+ 102us) server_negotiation.cc:407] Connection header received
0806 10:41:46.290709 (+ 4709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:46.290777 (+ 68us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:46.291838 (+ 1061us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:46.292735 (+ 897us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:46.295169 (+ 2434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:46.298654 (+ 3485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:46.300952 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:46.303072 (+ 2120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:46.303415 (+ 343us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:46.310407 (+ 6992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:46.310423 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:46.310466 (+ 43us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:46.310560 (+ 94us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:46.317396 (+ 6836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:46.318742 (+ 1346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:46.318765 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:46.318792 (+ 27us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:46.319182 (+ 390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:46.319739 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:46.319755 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:46.319759 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:46.321097 (+ 1338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:46.321642 (+ 545us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:46.322225 (+ 583us) server_negotiation.cc:299] Negotiation successful
0806 10:41:46.323125 (+ 900us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1030,"thread_start_us":611,"threads_started":1}
I20260806 10:41:46.331947 28272 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecddba99efa54ca8bbcb997598167b3c" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37983 } }
I20260806 10:41:46.332530 28272 raft_consensus.cc:374] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:46.332650 28272 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecddba99efa54ca8bbcb997598167b3c, State: Initialized, Role: FOLLOWER
I20260806 10:41:46.333400 28272 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecddba99efa54ca8bbcb997598167b3c" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37983 } }
I20260806 10:41:46.333745 28272 raft_consensus.cc:388] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:46.333904 28272 raft_consensus.cc:482] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:46.334090 28272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:46.338101 28272 raft_consensus.cc:504] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecddba99efa54ca8bbcb997598167b3c" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37983 } }
I20260806 10:41:46.338937 28272 leader_election.cc:302] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecddba99efa54ca8bbcb997598167b3c; no voters:
I20260806 10:41:46.340025 28272 leader_election.cc:288] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:46.340216 28279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:46.341882 28279 raft_consensus.cc:686] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [term 1 LEADER]: Becoming Leader. State: Replica: ecddba99efa54ca8bbcb997598167b3c, State: Running, Role: LEADER
I20260806 10:41:46.342798 28279 consensus_queue.cc:237] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecddba99efa54ca8bbcb997598167b3c" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37983 } }
I20260806 10:41:46.343672 28272 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:46.347319 28281 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ecddba99efa54ca8bbcb997598167b3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecddba99efa54ca8bbcb997598167b3c" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37983 } } }
I20260806 10:41:46.350708 28281 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:46.348763 28282 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ecddba99efa54ca8bbcb997598167b3c. Latest consensus state: current_term: 1 leader_uuid: "ecddba99efa54ca8bbcb997598167b3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecddba99efa54ca8bbcb997598167b3c" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37983 } } }
I20260806 10:41:46.350997 28282 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:46.352572 28290 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:46.362120 28290 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:46.379427 28290 catalog_manager.cc:1347] Generated new cluster ID: 7b82e6946104406299a9ae6f48aa78ae
I20260806 10:41:46.379616 28290 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:46.399551 28290 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:46.402963 28290 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:46.421145 28290 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c: Generated new TSK 0
I20260806 10:41:46.422652 28290 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab.
Entry for principal oryx/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab.
I20260806 10:41:46.527365 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:37983
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab
--principal=oryx/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:32845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:47.067519 28308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:47.067992 28308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:47.068185 28308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:47.079607 28308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:47.079787 28308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:47.079926 28308 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 10:41:47.080061 28308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:41:47.095525 28308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:32845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab
--principal=oryx/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.45.126:37983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:47.097568 28308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:47.099871 28308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:47.119767 28316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:47.119819 28322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:47.119865 28318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:47.121155 28308 server_base.cc:1034] running on GCE node
I20260806 10:41:47.122120 28308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:47.123584 28308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:47.124915 28308 hybrid_clock.cc:648] HybridClock initialized: now 1786012907124791 us; error 92 us; skew 500 ppm
I20260806 10:41:47.125435 28308 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:47 dist-test-slave-fgb3 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012907, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:47.130503 28308 init.cc:377] Logged in from keytab as oryx/127.16.45.65@KRBTEST.COM (short username oryx)
I20260806 10:41:47.132850 28308 webserver.cc:460] Webserver started at http://127.16.45.65:38217/ using document root <none> and password file <none>
I20260806 10:41:47.133967 28308 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:47.134146 28308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:47.134714 28308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:47.140125 28308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "cb82ce164e4c44b69e679430ef6c54d9"
format_stamp: "Formatted at 2026-08-06 10:41:47 on dist-test-slave-fgb3"
server_key: "007eb0fa2e2c4e69e74cc1e9dcb5ddbb"
server_key_iv: "9d1c53bfcc2045da26855d561f3e6410"
server_key_version: "encryptionkey@0"
I20260806 10:41:47.141455 28308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "cb82ce164e4c44b69e679430ef6c54d9"
format_stamp: "Formatted at 2026-08-06 10:41:47 on dist-test-slave-fgb3"
server_key: "007eb0fa2e2c4e69e74cc1e9dcb5ddbb"
server_key_iv: "9d1c53bfcc2045da26855d561f3e6410"
server_key_version: "encryptionkey@0"
I20260806 10:41:47.150007 28308 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.001s sys 0.008s
I20260806 10:41:47.156199 28331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:47.158631 28308 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.001s
I20260806 10:41:47.158907 28308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "cb82ce164e4c44b69e679430ef6c54d9"
format_stamp: "Formatted at 2026-08-06 10:41:47 on dist-test-slave-fgb3"
server_key: "007eb0fa2e2c4e69e74cc1e9dcb5ddbb"
server_key_iv: "9d1c53bfcc2045da26855d561f3e6410"
server_key_version: "encryptionkey@0"
I20260806 10:41:47.159324 28308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:47.209641 28308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:47.217178 28308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:47.217621 28308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:47.222174 28308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:47.222388 28308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 10:41:47.222684 28308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:47.222801 28308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 10:41:47 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012907, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
I20260806 10:41:47.262070 28347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:47.223272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:41195 (local address 127.16.45.126:37983)
0806 10:41:47.224097 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:47.224110 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:47.226675 (+ 2565us) server_negotiation.cc:407] Connection header received
0806 10:41:47.229872 (+ 3197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:47.229889 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:47.230038 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:47.230196 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:47.233992 (+ 3796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:47.235659 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:47.239839 (+ 4180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:47.240518 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:47.240756 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:47.249302 (+ 8546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:47.249322 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:47.249328 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:47.249420 (+ 92us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:47.255523 (+ 6103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:47.257445 (+ 1922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:47.257452 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:47.257466 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:47.257719 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:47.258813 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:47.258817 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:47.258827 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:47.259315 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:47.259492 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:47.261266 (+ 1774us) server_negotiation.cc:299] Negotiation successful
0806 10:41:47.261587 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":451,"threads_started":1}
I20260806 10:41:47.265558 28348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:47.224921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:37983 (local address 127.16.45.65:41195)
0806 10:41:47.226414 (+ 1493us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:47.226497 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:47.229421 (+ 2924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:47.230697 (+ 1276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:47.230725 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:47.231946 (+ 1221us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:47.233626 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:47.233688 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:47.235929 (+ 2241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:47.235948 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:47.239614 (+ 3666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:47.239638 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:47.241113 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:47.241131 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:47.241815 (+ 684us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:47.243285 (+ 1470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:47.243367 (+ 82us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:47.248809 (+ 5442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:47.255777 (+ 6968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:47.255799 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:47.255841 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:47.257171 (+ 1330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:47.257920 (+ 749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:47.257926 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:47.257939 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:47.258569 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:47.259508 (+ 939us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:47.259530 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:47.260464 (+ 934us) client_negotiation.cc:769] Sending connection context
0806 10:41:47.261048 (+ 584us) client_negotiation.cc:240] Negotiation successful
0806 10:41:47.262155 (+ 1107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":997,"thread_start_us":597,"threads_started":1}
I20260806 10:41:47.313879 28347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:47.285786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:53371 (local address 127.16.45.126:37983)
0806 10:41:47.286079 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:47.286096 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:47.292045 (+ 5949us) server_negotiation.cc:407] Connection header received
0806 10:41:47.292244 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:47.292261 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:47.292493 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:47.292689 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:47.295739 (+ 3050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:47.296982 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:47.299589 (+ 2607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:47.300556 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:47.300803 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:47.304148 (+ 3345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:47.304158 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:47.304173 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:47.304262 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:47.308918 (+ 4656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:47.309937 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:47.309949 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:47.309952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:47.310147 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:47.310814 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:47.310820 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:47.310824 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:47.311477 (+ 653us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:47.311777 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:47.312808 (+ 1031us) server_negotiation.cc:299] Negotiation successful
0806 10:41:47.313172 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 10:41:47.314138 28479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:47.286383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:37983 (local address 127.16.45.65:53371)
0806 10:41:47.291712 (+ 5329us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:47.291755 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:47.292046 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:47.293055 (+ 1009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:47.293063 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:47.294516 (+ 1453us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:47.295503 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:47.295532 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:47.297346 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:47.297355 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:47.299371 (+ 2016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:47.299394 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:47.301005 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:47.301024 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:47.301385 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:47.302401 (+ 1016us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:47.302468 (+ 67us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:47.303811 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:47.309093 (+ 5282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:47.309100 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:47.309113 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:47.309764 (+ 651us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:47.310335 (+ 571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:47.310351 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:47.310355 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:47.310549 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:47.311875 (+ 1326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:47.311880 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:47.312301 (+ 421us) client_negotiation.cc:769] Sending connection context
0806 10:41:47.312577 (+ 276us) client_negotiation.cc:240] Negotiation successful
0806 10:41:47.313172 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5036,"thread_start_us":4735,"threads_started":1}
I20260806 10:41:47.338263 28308 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:38551
I20260806 10:41:47.338306 28521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:38551 every 8 connection(s)
I20260806 10:41:47.340715 28308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:41:47.343918 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 28308
I20260806 10:41:47.344236 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:41:47.344269 28523 heartbeater.cc:347] Connected to a master server at 127.16.45.126:37983
I20260806 10:41:47.344633 28523 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:47.345449 16565 external_mini_cluster.cc:1428] Setting key 2a549ad004066443cd66ebc3f69ff791
I20260806 10:41:47.345774 28523 heartbeater.cc:511] Master 127.16.45.126:37983 requested a full tablet report, sending...
I20260806 10:41:47.349535 28201 ts_manager.cc:194] Registered new tserver with Master: cb82ce164e4c44b69e679430ef6c54d9 (127.16.45.65:38551)
I20260806 10:41:47.352054 28201 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:41195
WARNING: no policy specified for oryx/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab.
Entry for principal oryx/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab.
I20260806 10:41:47.427350 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:37983
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab
--principal=oryx/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:32845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:47.960425 28527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:47.960714 28527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:47.960861 28527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:47.968344 28527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:47.968477 28527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:47.968606 28527 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 10:41:47.968719 28527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:41:47.978672 28527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:32845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab
--principal=oryx/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.45.126:37983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:47.980015 28527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:47.981382 28527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:47.994460 28538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:47.994524 28542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:47.994546 28536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:47.995633 28527 server_base.cc:1034] running on GCE node
I20260806 10:41:47.996287 28527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:47.997202 28527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:47.998463 28527 hybrid_clock.cc:648] HybridClock initialized: now 1786012907998413 us; error 43 us; skew 500 ppm
I20260806 10:41:47.998745 28527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:48 dist-test-slave-fgb3 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012908, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:48.005129 28527 init.cc:377] Logged in from keytab as oryx/127.16.45.66@KRBTEST.COM (short username oryx)
I20260806 10:41:48.006707 28527 webserver.cc:460] Webserver started at http://127.16.45.66:38535/ using document root <none> and password file <none>
I20260806 10:41:48.007396 28527 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:48.007488 28527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:48.007786 28527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:48.010874 28527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "3a2fd3f3c7f2453fbe046c076dce2220"
format_stamp: "Formatted at 2026-08-06 10:41:48 on dist-test-slave-fgb3"
server_key: "f5c1cfe50c2fbf61e39213c81bb4cdc2"
server_key_iv: "3f90c0c46aa7ceb602835e1d0c8e8cd0"
server_key_version: "encryptionkey@0"
I20260806 10:41:48.011650 28527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "3a2fd3f3c7f2453fbe046c076dce2220"
format_stamp: "Formatted at 2026-08-06 10:41:48 on dist-test-slave-fgb3"
server_key: "f5c1cfe50c2fbf61e39213c81bb4cdc2"
server_key_iv: "3f90c0c46aa7ceb602835e1d0c8e8cd0"
server_key_version: "encryptionkey@0"
I20260806 10:41:48.016855 28527 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:41:48.020377 28552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:48.021696 28527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:41:48.021833 28527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "3a2fd3f3c7f2453fbe046c076dce2220"
format_stamp: "Formatted at 2026-08-06 10:41:48 on dist-test-slave-fgb3"
server_key: "f5c1cfe50c2fbf61e39213c81bb4cdc2"
server_key_iv: "3f90c0c46aa7ceb602835e1d0c8e8cd0"
server_key_version: "encryptionkey@0"
I20260806 10:41:48.022014 28527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:48.054560 28527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:48.058965 28527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:48.059206 28527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:48.061859 28527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:48.061959 28527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:48.062105 28527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:48.062162 28527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 10:41:48 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012908, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
I20260806 10:41:48.085131 28564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:48.062670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:51265 (local address 127.16.45.126:37983)
0806 10:41:48.063166 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:48.063172 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:48.064423 (+ 1251us) server_negotiation.cc:407] Connection header received
0806 10:41:48.067027 (+ 2604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:48.067034 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:48.067137 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:48.067266 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:48.069534 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.070489 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.072152 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.072597 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.072711 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:48.077666 (+ 4955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:48.077673 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:48.077678 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:48.077725 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:48.081050 (+ 3325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:48.082084 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:48.082090 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:48.082094 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:48.082279 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:48.082908 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:48.082914 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:48.082919 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:48.083309 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:48.083486 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:48.084472 (+ 986us) server_negotiation.cc:299] Negotiation successful
0806 10:41:48.084715 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":239,"threads_started":1}
I20260806 10:41:48.086790 28568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:48.063367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:37983 (local address 127.16.45.66:51265)
0806 10:41:48.064228 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:48.064280 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:48.066670 (+ 2390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:48.067615 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:48.067627 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:48.068404 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:48.069334 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:48.069359 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.070645 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.070651 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:48.071996 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:48.072019 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.072864 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.072873 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:48.073160 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:48.074039 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:48.074072 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:48.077418 (+ 3346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:48.081197 (+ 3779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:48.081208 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:48.081226 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:48.081883 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:48.082429 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:48.082434 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:48.082437 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:48.082727 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:48.083480 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:48.083490 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:48.083991 (+ 501us) client_negotiation.cc:769] Sending connection context
0806 10:41:48.084378 (+ 387us) client_negotiation.cc:240] Negotiation successful
0806 10:41:48.085023 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":371,"threads_started":1}
I20260806 10:41:48.103840 28527 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:38895
I20260806 10:41:48.103928 28730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:38895 every 8 connection(s)
I20260806 10:41:48.105088 28527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:41:48.107389 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 28527
I20260806 10:41:48.107452 28694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:48.093713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:37983 (local address 127.16.45.66:38113)
0806 10:41:48.094494 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:48.094513 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:48.094656 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:48.095211 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:48.095214 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:48.095845 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:48.096322 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:48.096337 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.097415 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.097419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:48.098493 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:48.098509 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.099486 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.099496 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:48.099677 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:48.100365 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:48.100391 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:48.101585 (+ 1194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:48.104880 (+ 3295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:48.104886 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:48.104890 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:48.105304 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:48.105647 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:48.105656 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:48.105660 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:48.105810 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:48.106542 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:48.106547 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:48.106744 (+ 197us) client_negotiation.cc:769] Sending connection context
0806 10:41:48.106861 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 10:41:48.107099 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":402,"threads_started":1}
I20260806 10:41:48.107573 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:41:48.107637 28731 heartbeater.cc:347] Connected to a master server at 127.16.45.126:37983
I20260806 10:41:48.107831 28731 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:48.108000 28564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:48.093759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:38113 (local address 127.16.45.126:37983)
0806 10:41:48.093967 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:48.093973 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:48.094595 (+ 622us) server_negotiation.cc:407] Connection header received
0806 10:41:48.094823 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:48.094829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:48.094931 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:48.095006 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:48.096478 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.097271 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.098623 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.099101 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.099224 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:48.101849 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:48.101854 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:48.101857 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:48.101889 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:48.104757 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:48.105412 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:48.105417 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:48.105421 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:48.105543 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:48.105961 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:48.105966 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:48.105969 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:48.106433 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:48.106566 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:48.107263 (+ 697us) server_negotiation.cc:299] Negotiation successful
0806 10:41:48.107491 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 10:41:48.108141 16565 external_mini_cluster.cc:1428] Setting key dfebe5cf2605954bc9b839e2319ee7e8
I20260806 10:41:48.108417 28731 heartbeater.cc:511] Master 127.16.45.126:37983 requested a full tablet report, sending...
I20260806 10:41:48.109767 28201 ts_manager.cc:194] Registered new tserver with Master: 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895)
I20260806 10:41:48.110754 28201 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:51265
WARNING: no policy specified for oryx/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab.
Entry for principal oryx/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab.
I20260806 10:41:48.163785 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:37983
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab
--principal=oryx/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:32845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:41:48.356501 28523 heartbeater.cc:503] Master 127.16.45.126:37983 was elected leader, sending a full tablet report...
W20260806 10:41:48.502300 28738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:48.502592 28738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:48.502748 28738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:48.510030 28738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:48.510136 28738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:48.510268 28738 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 10:41:48.510401 28738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:41:48.520418 28738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:32845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab
--principal=oryx/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.45.126:37983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:48.521701 28738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:48.523094 28738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:48.535928 28748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:48.536010 28744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:48.536031 28751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:48.536931 28738 server_base.cc:1034] running on GCE node
I20260806 10:41:48.537514 28738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:48.538511 28738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:48.539734 28738 hybrid_clock.cc:648] HybridClock initialized: now 1786012908539664 us; error 48 us; skew 500 ppm
I20260806 10:41:48.540040 28738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:48 dist-test-slave-fgb3 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012908, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:48.543221 28738 init.cc:377] Logged in from keytab as oryx/127.16.45.67@KRBTEST.COM (short username oryx)
I20260806 10:41:48.544806 28738 webserver.cc:460] Webserver started at http://127.16.45.67:38977/ using document root <none> and password file <none>
I20260806 10:41:48.545647 28738 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:48.545750 28738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:48.546073 28738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:48.549242 28738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "9f00535193bf473f9d252c05bbf12feb"
format_stamp: "Formatted at 2026-08-06 10:41:48 on dist-test-slave-fgb3"
server_key: "54acb16ef22d190cafd115aba661d94a"
server_key_iv: "34a6b0fd8d723fc52263d9b73866e273"
server_key_version: "encryptionkey@0"
I20260806 10:41:48.550055 28738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "9f00535193bf473f9d252c05bbf12feb"
format_stamp: "Formatted at 2026-08-06 10:41:48 on dist-test-slave-fgb3"
server_key: "54acb16ef22d190cafd115aba661d94a"
server_key_iv: "34a6b0fd8d723fc52263d9b73866e273"
server_key_version: "encryptionkey@0"
I20260806 10:41:48.555567 28738 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 10:41:48.559093 28762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:48.560422 28738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:41:48.560575 28738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "9f00535193bf473f9d252c05bbf12feb"
format_stamp: "Formatted at 2026-08-06 10:41:48 on dist-test-slave-fgb3"
server_key: "54acb16ef22d190cafd115aba661d94a"
server_key_iv: "34a6b0fd8d723fc52263d9b73866e273"
server_key_version: "encryptionkey@0"
I20260806 10:41:48.560791 28738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:48.589355 28738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:48.593741 28738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:48.594022 28738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:48.596716 28738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:48.596813 28738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:48.596961 28738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:48.597026 28738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 10:41:48 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012908, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
I20260806 10:41:48.620345 28564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:48.597529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:34761 (local address 127.16.45.126:37983)
0806 10:41:48.597740 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:48.597745 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:48.599225 (+ 1480us) server_negotiation.cc:407] Connection header received
0806 10:41:48.601475 (+ 2250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:48.601480 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:48.601592 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:48.601699 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:48.604067 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.605067 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.607712 (+ 2645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.608290 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.608434 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:48.613355 (+ 4921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:48.613360 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:48.613363 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:48.613408 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:48.616489 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:48.617473 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:48.617480 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:48.617484 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:48.617667 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:48.618273 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:48.618279 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:48.618283 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:48.618718 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:48.618865 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:48.619719 (+ 854us) server_negotiation.cc:299] Negotiation successful
0806 10:41:48.619962 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260806 10:41:48.621632 28774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:48.598238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:37983 (local address 127.16.45.67:34761)
0806 10:41:48.599072 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:48.599113 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:48.601163 (+ 2050us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:48.602068 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:48.602089 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:48.603003 (+ 914us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:48.603850 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:48.603876 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.605283 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.605287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:48.607521 (+ 2234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:48.607545 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.608551 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.608559 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:48.608808 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:48.609637 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:48.609681 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:48.613093 (+ 3412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:48.616628 (+ 3535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:48.616640 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:48.616661 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:48.617307 (+ 646us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:48.617798 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:48.617804 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:48.617808 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:48.618145 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:48.618870 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:48.618879 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:48.619274 (+ 395us) client_negotiation.cc:769] Sending connection context
0806 10:41:48.619528 (+ 254us) client_negotiation.cc:240] Negotiation successful
0806 10:41:48.620152 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":336,"threads_started":1}
I20260806 10:41:48.637677 28738 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:42027
I20260806 10:41:48.637750 28933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:42027 every 8 connection(s)
I20260806 10:41:48.639228 28738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:41:48.640496 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 28738
I20260806 10:41:48.640668 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:41:48.641146 16565 external_mini_cluster.cc:1428] Setting key 7e869b44d807332685fb3f818c4bf360
I20260806 10:41:48.641605 28934 heartbeater.cc:347] Connected to a master server at 127.16.45.126:37983
I20260806 10:41:48.642165 28934 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:48.643072 28934 heartbeater.cc:511] Master 127.16.45.126:37983 requested a full tablet report, sending...
I20260806 10:41:48.645077 28201 ts_manager.cc:194] Registered new tserver with Master: 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027)
I20260806 10:41:48.646165 28201 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:34761
I20260806 10:41:48.646370 28891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:48.629398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:37983 (local address 127.16.45.67:39817)
0806 10:41:48.630101 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:48.630122 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:48.630293 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:48.630730 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:48.630736 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:48.631412 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:48.631915 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:48.631931 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.633492 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.633501 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:48.635262 (+ 1761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:48.635279 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.636250 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.636258 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:48.636443 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:48.637324 (+ 881us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:48.637356 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:48.638414 (+ 1058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:48.643871 (+ 5457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:48.643875 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:48.643878 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:48.644315 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:48.644748 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:48.644753 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:48.644757 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:48.644880 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:48.645525 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:48.645529 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:48.645688 (+ 159us) client_negotiation.cc:769] Sending connection context
0806 10:41:48.645795 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 10:41:48.646034 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":359,"threads_started":1}
I20260806 10:41:48.646497 28564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:48.629346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:39817 (local address 127.16.45.126:37983)
0806 10:41:48.629564 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:48.629570 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:48.630224 (+ 654us) server_negotiation.cc:407] Connection header received
0806 10:41:48.630462 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:48.630469 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:48.630563 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:48.630676 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:48.632093 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.633295 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.635450 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.636061 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.636198 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:48.638605 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:48.638611 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:48.638617 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:48.638659 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:48.643734 (+ 5075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:48.644438 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:48.644443 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:48.644447 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:48.644639 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:48.644994 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:48.644999 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:48.645002 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:48.645408 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:48.645552 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:48.645946 (+ 394us) server_negotiation.cc:299] Negotiation successful
0806 10:41:48.646170 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 10:41:48.656948 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 10:41:48 dist-test-slave-fgb3 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012908, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 10:41:48 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:41:48 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:41:49.113777 28731 heartbeater.cc:503] Master 127.16.45.126:37983 was elected leader, sending a full tablet report...
I20260806 10:41:49.649384 28934 heartbeater.cc:503] Master 127.16.45.126:37983 was elected leader, sending a full tablet report...
W20260806 10:41:49.695187 28946 sasl_common.cc:323] Time spent calling sasl_client_start(): real 0.988s user 0.004s sys 0.015s
W20260806 10:41:49.696501 28564 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:41:48.702071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48580 (local address 127.16.45.126:37983)
0806 10:41:48.702260 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:48.702265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:48.702585 (+ 320us) server_negotiation.cc:407] Connection header received
0806 10:41:48.702795 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:48.702800 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:48.702870 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:48.702975 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:48.704276 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.705024 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.706221 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:48.706731 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:48.706828 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.696205 (+989377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48580: BlockingRecv error: recv got EOF from 127.0.0.1:48580 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 06 10:41:49 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012908, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
I20260806 10:41:49.714501 28564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:49.700753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48592 (local address 127.16.45.126:37983)
0806 10:41:49.700991 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:49.700998 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:49.701257 (+ 259us) server_negotiation.cc:407] Connection header received
0806 10:41:49.701477 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:49.701481 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:49.701549 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:49.701639 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:49.702975 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.703713 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.705032 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.705485 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.705601 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.709336 (+ 3735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:49.709343 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:49.709346 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:49.709382 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:49.711910 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:49.712545 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:49.712550 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:49.712552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:49.712679 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:49.713043 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:49.713048 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:49.713050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:49.713325 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:49.713575 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:49.713886 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 10:41:49.714130 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:41:49.718654 28201 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48592:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:41:49.725823 28201 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:49.748806 28963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:49.737845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:38895 (local address 127.0.0.1:47722)
0806 10:41:49.739236 (+ 1391us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:49.739259 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:49.739362 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:49.741697 (+ 2335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:49.741702 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:49.741730 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:49.742190 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:49.742205 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.744307 (+ 2102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.744313 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:49.746474 (+ 2161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:49.746489 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.748105 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.748109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:49.748237 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.748277 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 10:41:49.748356 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 10:41:49.748497 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1263,"mutex_wait_us":64,"thread_start_us":1098,"threads_started":1}
I20260806 10:41:49.749804 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:49.738419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47722 (local address 127.16.45.66:38895)
0806 10:41:49.741139 (+ 2720us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:49.741149 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:49.741177 (+ 28us) server_negotiation.cc:407] Connection header received
0806 10:41:49.741274 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:49.741282 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:49.741512 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:49.741710 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:49.742455 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.744190 (+ 1735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.746666 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.747894 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.749203 (+ 1309us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.749351 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:49.749414 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 10:41:49.749530 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2541,"thread_start_us":2400,"threads_started":1}
I20260806 10:41:49.750056 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:49.737632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38551 (local address 127.0.0.1:32782)
0806 10:41:49.738645 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:49.738694 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:49.738879 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:49.740723 (+ 1844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:49.740730 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:49.740759 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:49.741181 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:49.741196 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.743999 (+ 2803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.744004 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:49.746830 (+ 2826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:49.746847 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.749281 (+ 2434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.749287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:49.749449 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.749483 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 10:41:49.749571 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 10:41:49.749695 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":744,"mutex_wait_us":65,"thread_start_us":567,"threads_started":1}
I20260806 10:41:49.750073 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:49.737874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32782 (local address 127.16.45.65:38551)
0806 10:41:49.739867 (+ 1993us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:49.739876 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:49.739905 (+ 29us) server_negotiation.cc:407] Connection header received
0806 10:41:49.740002 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:49.740010 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:49.740254 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:49.740456 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:49.741416 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.743850 (+ 2434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.747370 (+ 3520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.748813 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.748931 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.749139 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:49.749636 (+ 497us) server_negotiation.cc:299] Negotiation successful
0806 10:41:49.749799 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1839,"thread_start_us":1694,"threads_started":1}
I20260806 10:41:49.751403 28965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:49.739337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:42027 (local address 127.0.0.1:44422)
0806 10:41:49.742400 (+ 3063us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:49.742424 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:49.742535 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:49.744108 (+ 1573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:49.744113 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:49.744141 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:49.744773 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:49.744786 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.746609 (+ 1823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.746614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:49.748783 (+ 2169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:49.748803 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.750695 (+ 1892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.750702 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:49.750861 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.750903 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 10:41:49.750990 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 10:41:49.751106 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2921,"thread_start_us":2737,"threads_started":1}
I20260806 10:41:49.752063 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:49.739609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44422 (local address 127.16.45.67:42027)
0806 10:41:49.743459 (+ 3850us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:49.743467 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:49.743494 (+ 27us) server_negotiation.cc:407] Connection header received
0806 10:41:49.743632 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:49.743644 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:49.743876 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:49.744095 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:49.744942 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.746461 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.748983 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.750472 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.750610 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.750810 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:49.751614 (+ 804us) server_negotiation.cc:299] Negotiation successful
0806 10:41:49.751774 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3698,"thread_start_us":3253,"threads_started":1}
I20260806 10:41:49.753430 28629 tablet_service.cc:1467] Processing CreateTablet for tablet fa42be0e7a7e47f882ad7a63fafca296 (DEFAULT_TABLE table=test-table [id=82e7a395e6084024a8a4970c613d52c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:49.753422 28411 tablet_service.cc:1467] Processing CreateTablet for tablet fa42be0e7a7e47f882ad7a63fafca296 (DEFAULT_TABLE table=test-table [id=82e7a395e6084024a8a4970c613d52c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:49.754582 28411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa42be0e7a7e47f882ad7a63fafca296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:49.754599 28629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa42be0e7a7e47f882ad7a63fafca296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:49.757846 28833 tablet_service.cc:1467] Processing CreateTablet for tablet fa42be0e7a7e47f882ad7a63fafca296 (DEFAULT_TABLE table=test-table [id=82e7a395e6084024a8a4970c613d52c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:49.759191 28833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa42be0e7a7e47f882ad7a63fafca296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:49.766757 28967 tablet_bootstrap.cc:492] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220: Bootstrap starting.
I20260806 10:41:49.769444 28967 tablet_bootstrap.cc:654] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:49.770483 28967 log.cc:824] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:49.771085 28969 tablet_bootstrap.cc:492] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9: Bootstrap starting.
I20260806 10:41:49.774005 28967 tablet_bootstrap.cc:492] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220: No bootstrap required, opened a new log
I20260806 10:41:49.774304 28967 ts_tablet_manager.cc:1397] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 10:41:49.774684 28969 tablet_bootstrap.cc:654] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:49.775899 28969 log.cc:824] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:49.776664 28971 tablet_bootstrap.cc:492] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb: Bootstrap starting.
I20260806 10:41:49.779562 28971 tablet_bootstrap.cc:654] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:49.779839 28969 tablet_bootstrap.cc:492] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9: No bootstrap required, opened a new log
I20260806 10:41:49.780098 28969 ts_tablet_manager.cc:1397] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 10:41:49.780526 28971 log.cc:824] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:49.783236 28971 tablet_bootstrap.cc:492] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb: No bootstrap required, opened a new log
I20260806 10:41:49.783479 28971 ts_tablet_manager.cc:1397] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 10:41:49.784138 28967 raft_consensus.cc:348] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.784571 28967 raft_consensus.cc:374] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:49.784709 28967 raft_consensus.cc:729] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2fd3f3c7f2453fbe046c076dce2220, State: Initialized, Role: FOLLOWER
I20260806 10:41:49.785326 28967 consensus_queue.cc:260] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.787075 28967 ts_tablet_manager.cc:1428] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220: Time spent starting tablet: real 0.013s user 0.007s sys 0.005s
I20260806 10:41:49.789940 28969 raft_consensus.cc:348] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.790455 28969 raft_consensus.cc:374] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:49.790563 28969 raft_consensus.cc:729] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb82ce164e4c44b69e679430ef6c54d9, State: Initialized, Role: FOLLOWER
I20260806 10:41:49.791101 28969 consensus_queue.cc:260] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.791702 28971 raft_consensus.cc:348] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.792172 28971 raft_consensus.cc:374] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:49.792685 28971 raft_consensus.cc:729] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f00535193bf473f9d252c05bbf12feb, State: Initialized, Role: FOLLOWER
I20260806 10:41:49.792838 28969 ts_tablet_manager.cc:1428] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260806 10:41:49.793416 28971 consensus_queue.cc:260] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.794958 28971 ts_tablet_manager.cc:1428] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
W20260806 10:41:49.845443 28524 tablet.cc:2369] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:41:49.848445 28978 raft_consensus.cc:482] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:49.848714 28978 raft_consensus.cc:504] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.850337 28978 leader_election.cc:288] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895), 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027)
I20260806 10:41:49.857177 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:49.850817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:44217 (local address 127.16.45.66:38895)
0806 10:41:49.851076 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:49.851082 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:49.851306 (+ 224us) server_negotiation.cc:407] Connection header received
0806 10:41:49.851609 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:49.851615 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:49.851710 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:49.851806 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:49.852498 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.853424 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.855377 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.856222 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.856340 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.856394 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:49.856795 (+ 401us) server_negotiation.cc:299] Negotiation successful
0806 10:41:49.856946 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 10:41:49.857236 28980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:49.850551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:38895 (local address 127.16.45.65:44217)
0806 10:41:49.851194 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:49.851215 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:49.851443 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:49.851842 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:49.851847 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:49.851877 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:49.852338 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:49.852351 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.853545 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.853550 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:49.855233 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:49.855245 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.856433 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.856439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:49.856619 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.856669 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 10:41:49.856745 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 10:41:49.856833 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"mutex_wait_us":42,"thread_start_us":295,"threads_started":1}
I20260806 10:41:49.857287 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:49.851579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:60071 (local address 127.16.45.67:42027)
0806 10:41:49.851748 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:49.851753 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:49.852053 (+ 300us) server_negotiation.cc:407] Connection header received
0806 10:41:49.852219 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:49.852224 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:49.852314 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:49.852404 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:49.852981 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.853745 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.855654 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.856436 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.856592 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.856660 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:49.856956 (+ 296us) server_negotiation.cc:299] Negotiation successful
0806 10:41:49.857081 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 10:41:49.857441 28981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:49.851212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:42027 (local address 127.16.45.65:60071)
0806 10:41:49.851946 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:49.851962 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:49.852090 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:49.852441 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:49.852445 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:49.852470 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:49.852838 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:49.852851 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.853891 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.853895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:49.855501 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:49.855515 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.856632 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.856637 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:49.856794 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.856826 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 10:41:49.856912 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 10:41:49.857027 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"mutex_wait_us":59,"thread_start_us":538,"threads_started":1}
W20260806 10:41:49.858017 28734 tablet.cc:2369] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:41:49.858525 28862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa42be0e7a7e47f882ad7a63fafca296" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f00535193bf473f9d252c05bbf12feb" is_pre_election: true
I20260806 10:41:49.858597 28658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa42be0e7a7e47f882ad7a63fafca296" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" is_pre_election: true
I20260806 10:41:49.859113 28862 raft_consensus.cc:2454] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 0.
I20260806 10:41:49.859113 28658 raft_consensus.cc:2454] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 0.
I20260806 10:41:49.859737 28335 leader_election.cc:302] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2fd3f3c7f2453fbe046c076dce2220, cb82ce164e4c44b69e679430ef6c54d9; no voters:
I20260806 10:41:49.860083 28978 raft_consensus.cc:2781] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:49.860235 28978 raft_consensus.cc:482] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:49.860348 28978 raft_consensus.cc:3037] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:49.862478 28978 raft_consensus.cc:504] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.862996 28978 leader_election.cc:288] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 election: Requested vote from peers 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895), 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027)
I20260806 10:41:49.863428 28658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa42be0e7a7e47f882ad7a63fafca296" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2fd3f3c7f2453fbe046c076dce2220"
I20260806 10:41:49.863452 28862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa42be0e7a7e47f882ad7a63fafca296" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f00535193bf473f9d252c05bbf12feb"
I20260806 10:41:49.863608 28658 raft_consensus.cc:3037] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:49.863617 28862 raft_consensus.cc:3037] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:49.866191 28658 raft_consensus.cc:2454] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 1.
I20260806 10:41:49.866211 28862 raft_consensus.cc:2454] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 1.
I20260806 10:41:49.866595 28335 leader_election.cc:302] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f00535193bf473f9d252c05bbf12feb, cb82ce164e4c44b69e679430ef6c54d9; no voters:
I20260806 10:41:49.866904 28978 raft_consensus.cc:2781] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:49.867336 28978 raft_consensus.cc:686] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 LEADER]: Becoming Leader. State: Replica: cb82ce164e4c44b69e679430ef6c54d9, State: Running, Role: LEADER
I20260806 10:41:49.867781 28978 consensus_queue.cc:237] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.872505 28201 catalog_manager.cc:5495] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb82ce164e4c44b69e679430ef6c54d9 (127.16.45.65). New cstate: current_term: 1 leader_uuid: "cb82ce164e4c44b69e679430ef6c54d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } health_report { overall_health: UNKNOWN } } }
W20260806 10:41:49.891779 28936 tablet.cc:2369] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:41:49.908258 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:49.903515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32788 (local address 127.16.45.65:38551)
0806 10:41:49.903691 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:49.903695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:49.903714 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:41:49.903886 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:49.903889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:49.903989 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:49.904124 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:49.904424 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.905143 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.906393 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:49.906793 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:49.906910 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:49.907258 (+ 348us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:49.907792 (+ 534us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:49.907917 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:49.907981 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 10:41:49.908046 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 10:41:49.915959 28862 raft_consensus.cc:1261] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Refusing update from remote peer cb82ce164e4c44b69e679430ef6c54d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:49.915994 28658 raft_consensus.cc:1261] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Refusing update from remote peer cb82ce164e4c44b69e679430ef6c54d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:49.916834 28982 consensus_queue.cc:1035] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:49.917171 28978 consensus_queue.cc:1035] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:49.930537 28988 mvcc.cc:205] Tried to move back new op lower bound from 7315508879006326784 to 7315508878822084608. Current Snapshot: MvccSnapshot[applied={T|T < 7315508879006326784}]
I20260806 10:41:49.932082 28986 mvcc.cc:205] Tried to move back new op lower bound from 7315508879006326784 to 7315508878822084608. Current Snapshot: MvccSnapshot[applied={T|T < 7315508879006326784}]
I20260806 10:41:49.940441 28202 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48592:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:49.940728 28202 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48592:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:49.944679 28202 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c: Sending DeleteTablet for 3 replicas of tablet fa42be0e7a7e47f882ad7a63fafca296
I20260806 10:41:49.945891 28411 tablet_service.cc:1514] Processing DeleteTablet for tablet fa42be0e7a7e47f882ad7a63fafca296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:49 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:32782
I20260806 10:41:49.946027 28833 tablet_service.cc:1514] Processing DeleteTablet for tablet fa42be0e7a7e47f882ad7a63fafca296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:49 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:44422
I20260806 10:41:49.946013 28629 tablet_service.cc:1514] Processing DeleteTablet for tablet fa42be0e7a7e47f882ad7a63fafca296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:49 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:47722
I20260806 10:41:49.947976 28202 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48592:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:41:49.948997 28202 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:49.958845 28997 tablet_replica.cc:330] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220: stopping tablet replica
I20260806 10:41:49.959447 28628 tablet_service.cc:1467] Processing CreateTablet for tablet 14723230f5664147a7beca8230d4274d (DEFAULT_TABLE table=test-table [id=8e20874c965242dca2961b9d610a29e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:49.959602 28832 tablet_service.cc:1467] Processing CreateTablet for tablet 14723230f5664147a7beca8230d4274d (DEFAULT_TABLE table=test-table [id=8e20874c965242dca2961b9d610a29e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:49.960110 28628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14723230f5664147a7beca8230d4274d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:49.960253 28832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14723230f5664147a7beca8230d4274d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:49.961541 28996 tablet_replica.cc:330] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb: stopping tablet replica
I20260806 10:41:49.962050 28996 raft_consensus.cc:2229] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:49.962630 28996 raft_consensus.cc:2258] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:49.965001 28996 ts_tablet_manager.cc:1905] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:49.967391 28967 tablet_bootstrap.cc:492] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220: Bootstrap starting.
I20260806 10:41:49.969014 28971 tablet_bootstrap.cc:492] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb: Bootstrap starting.
I20260806 10:41:49.969111 28967 tablet_bootstrap.cc:654] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:49.970667 28971 tablet_bootstrap.cc:654] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:49.971876 28996 ts_tablet_manager.cc:1918] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:49.972072 28996 log.cc:1196] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/fa42be0e7a7e47f882ad7a63fafca296
I20260806 10:41:49.972668 28996 ts_tablet_manager.cc:1939] T fa42be0e7a7e47f882ad7a63fafca296 P 9f00535193bf473f9d252c05bbf12feb: Deleting consensus metadata
I20260806 10:41:49.974599 28182 catalog_manager.cc:4841] TS 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027): tablet fa42be0e7a7e47f882ad7a63fafca296 (table test-table [id=82e7a395e6084024a8a4970c613d52c4]) successfully deleted
I20260806 10:41:49.976727 28997 raft_consensus.cc:2229] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:49.977145 28997 raft_consensus.cc:2258] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:49.980084 28997 ts_tablet_manager.cc:1905] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:49.980643 28967 tablet_bootstrap.cc:492] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220: No bootstrap required, opened a new log
I20260806 10:41:49.980798 28967 ts_tablet_manager.cc:1397] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.010s
I20260806 10:41:49.981771 28967 raft_consensus.cc:348] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.982048 28967 raft_consensus.cc:374] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:49.982189 28967 raft_consensus.cc:729] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2fd3f3c7f2453fbe046c076dce2220, State: Initialized, Role: FOLLOWER
I20260806 10:41:49.982548 28967 consensus_queue.cc:260] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.983980 28967 ts_tablet_manager.cc:1428] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:49.985965 28971 tablet_bootstrap.cc:492] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb: No bootstrap required, opened a new log
I20260806 10:41:49.986187 28971 ts_tablet_manager.cc:1397] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.007s
I20260806 10:41:49.987323 28971 raft_consensus.cc:348] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.987644 28971 raft_consensus.cc:374] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:49.987803 28971 raft_consensus.cc:729] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f00535193bf473f9d252c05bbf12feb, State: Initialized, Role: FOLLOWER
I20260806 10:41:49.988180 28971 consensus_queue.cc:260] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:49.988358 28997 ts_tablet_manager.cc:1918] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:49.988924 28971 ts_tablet_manager.cc:1428] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 10:41:49.989465 28409 tablet_service.cc:1467] Processing CreateTablet for tablet 14723230f5664147a7beca8230d4274d (DEFAULT_TABLE table=test-table [id=8e20874c965242dca2961b9d610a29e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:49.989758 28997 log.cc:1196] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/fa42be0e7a7e47f882ad7a63fafca296
I20260806 10:41:49.989921 28999 tablet_replica.cc:330] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9: stopping tablet replica
I20260806 10:41:49.990183 28409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14723230f5664147a7beca8230d4274d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:49.990386 28997 ts_tablet_manager.cc:1939] T fa42be0e7a7e47f882ad7a63fafca296 P 3a2fd3f3c7f2453fbe046c076dce2220: Deleting consensus metadata
I20260806 10:41:49.990460 28999 raft_consensus.cc:2229] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:41:49.991187 28999 raft_consensus.cc:2258] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:49.992136 28182 catalog_manager.cc:4841] TS 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895): tablet fa42be0e7a7e47f882ad7a63fafca296 (table test-table [id=82e7a395e6084024a8a4970c613d52c4]) successfully deleted
I20260806 10:41:49.993340 28999 ts_tablet_manager.cc:1905] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:49.996136 28969 tablet_bootstrap.cc:492] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9: Bootstrap starting.
I20260806 10:41:49.997514 28969 tablet_bootstrap.cc:654] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:49.999114 28999 ts_tablet_manager.cc:1918] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:49.999256 28999 log.cc:1196] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/fa42be0e7a7e47f882ad7a63fafca296
I20260806 10:41:49.999496 28969 tablet_bootstrap.cc:492] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9: No bootstrap required, opened a new log
I20260806 10:41:49.999647 28969 ts_tablet_manager.cc:1397] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 10:41:49.999768 28999 ts_tablet_manager.cc:1939] T fa42be0e7a7e47f882ad7a63fafca296 P cb82ce164e4c44b69e679430ef6c54d9: Deleting consensus metadata
I20260806 10:41:50.000344 28969 raft_consensus.cc:348] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.000625 28969 raft_consensus.cc:374] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:50.000749 28969 raft_consensus.cc:729] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb82ce164e4c44b69e679430ef6c54d9, State: Initialized, Role: FOLLOWER
I20260806 10:41:50.001003 28969 consensus_queue.cc:260] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.001394 28184 catalog_manager.cc:4841] TS cb82ce164e4c44b69e679430ef6c54d9 (127.16.45.65:38551): tablet fa42be0e7a7e47f882ad7a63fafca296 (table test-table [id=82e7a395e6084024a8a4970c613d52c4]) successfully deleted
I20260806 10:41:50.001500 28969 ts_tablet_manager.cc:1428] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 10:41:50.170008 28979 raft_consensus.cc:482] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:50.170252 28979 raft_consensus.cc:504] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.171806 28979 leader_election.cc:288] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb82ce164e4c44b69e679430ef6c54d9 (127.16.45.65:38551), 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895)
I20260806 10:41:50.179562 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.172429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:51393 (local address 127.16.45.66:38895)
0806 10:41:50.172614 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:50.172621 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:50.173440 (+ 819us) server_negotiation.cc:407] Connection header received
0806 10:41:50.173526 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:50.173531 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:50.173599 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:50.173678 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:50.174571 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.175601 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.177508 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.178567 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.178730 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.178805 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:50.179153 (+ 348us) server_negotiation.cc:299] Negotiation successful
0806 10:41:50.179281 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 10:41:50.179683 29005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.172106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:38895 (local address 127.16.45.67:51393)
0806 10:41:50.173284 (+ 1178us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:50.173304 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:50.173405 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:50.173861 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:50.173869 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:50.173898 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:50.174380 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:50.174392 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.175722 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.175727 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:50.177312 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:50.177357 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.178790 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.178797 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:50.178979 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.179017 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 10:41:50.179116 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 10:41:50.179252 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1053,"mutex_wait_us":585,"thread_start_us":336,"threads_started":1}
I20260806 10:41:50.180470 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.172282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:58983 (local address 127.16.45.65:38551)
0806 10:41:50.172503 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:50.172510 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:50.173154 (+ 644us) server_negotiation.cc:407] Connection header received
0806 10:41:50.173474 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:50.173480 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:50.173561 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:50.173664 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:41:50.174297 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.175530 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.178092 (+ 2562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.179242 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.179410 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.179475 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:50.180024 (+ 549us) server_negotiation.cc:299] Negotiation successful
0806 10:41:50.180156 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 10:41:50.180570 28658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14723230f5664147a7beca8230d4274d" candidate_uuid: "9f00535193bf473f9d252c05bbf12feb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" is_pre_election: true
I20260806 10:41:50.180835 28658 raft_consensus.cc:2454] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f00535193bf473f9d252c05bbf12feb in term 0.
I20260806 10:41:50.181133 29003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.172106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38551 (local address 127.16.45.67:58983)
0806 10:41:50.173033 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:50.173056 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:50.173273 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:50.173699 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:50.173704 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:50.173729 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:41:50.174116 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:50.174130 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.175691 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.175696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:50.177906 (+ 2210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:50.177922 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.179653 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.179662 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:50.179837 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.179869 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 10:41:50.180508 (+ 639us) client_negotiation.cc:240] Negotiation successful
0806 10:41:50.180729 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"mutex_wait_us":2,"thread_start_us":558,"threads_started":1}
I20260806 10:41:50.181401 28765 leader_election.cc:302] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2fd3f3c7f2453fbe046c076dce2220, 9f00535193bf473f9d252c05bbf12feb; no voters:
I20260806 10:41:50.181823 28979 raft_consensus.cc:2781] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:50.181954 28979 raft_consensus.cc:482] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:50.182061 28979 raft_consensus.cc:3037] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:50.182010 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14723230f5664147a7beca8230d4274d" candidate_uuid: "9f00535193bf473f9d252c05bbf12feb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb82ce164e4c44b69e679430ef6c54d9" is_pre_election: true
I20260806 10:41:50.182605 28446 raft_consensus.cc:2454] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f00535193bf473f9d252c05bbf12feb in term 0.
I20260806 10:41:50.184672 28979 raft_consensus.cc:504] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.185389 28979 leader_election.cc:288] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [CANDIDATE]: Term 1 election: Requested vote from peers cb82ce164e4c44b69e679430ef6c54d9 (127.16.45.65:38551), 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895)
I20260806 10:41:50.186067 28658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14723230f5664147a7beca8230d4274d" candidate_uuid: "9f00535193bf473f9d252c05bbf12feb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2fd3f3c7f2453fbe046c076dce2220"
I20260806 10:41:50.186286 28658 raft_consensus.cc:3037] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:50.186753 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14723230f5664147a7beca8230d4274d" candidate_uuid: "9f00535193bf473f9d252c05bbf12feb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb82ce164e4c44b69e679430ef6c54d9"
I20260806 10:41:50.187100 28446 raft_consensus.cc:3037] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:50.189215 28658 raft_consensus.cc:2454] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f00535193bf473f9d252c05bbf12feb in term 1.
I20260806 10:41:50.189627 28765 leader_election.cc:302] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2fd3f3c7f2453fbe046c076dce2220, 9f00535193bf473f9d252c05bbf12feb; no voters:
I20260806 10:41:50.189916 28979 raft_consensus.cc:2781] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:50.190688 28446 raft_consensus.cc:2454] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f00535193bf473f9d252c05bbf12feb in term 1.
I20260806 10:41:50.197253 28979 raft_consensus.cc:686] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 1 LEADER]: Becoming Leader. State: Replica: 9f00535193bf473f9d252c05bbf12feb, State: Running, Role: LEADER
I20260806 10:41:50.197654 28979 consensus_queue.cc:237] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.201470 28201 catalog_manager.cc:5495] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f00535193bf473f9d252c05bbf12feb (127.16.45.67). New cstate: current_term: 1 leader_uuid: "9f00535193bf473f9d252c05bbf12feb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } health_report { overall_health: HEALTHY } } }
Aug 06 10:41:50 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012906, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.126@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
I20260806 10:41:50.260272 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.244923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:37983 (local address 127.0.0.1:48600)
0806 10:41:50.245889 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:50.245909 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:50.246041 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:50.246460 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:50.246464 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:50.247159 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:50.247480 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:50.247490 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.249028 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.249034 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:50.250043 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:50.250056 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.251025 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.251030 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:50.251145 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.251851 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:50.251875 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:50.254065 (+ 2190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:50.257755 (+ 3690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:50.257767 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:50.257773 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:50.258211 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:50.258690 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:50.258693 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:50.258696 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:50.258849 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:50.259475 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:50.259482 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:50.259642 (+ 160us) client_negotiation.cc:769] Sending connection context
0806 10:41:50.259776 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 10:41:50.259990 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":812,"thread_start_us":652,"threads_started":1}
I20260806 10:41:50.260625 29019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.245001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48600 (local address 127.16.45.126:37983)
0806 10:41:50.245726 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:50.245733 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:50.246008 (+ 275us) server_negotiation.cc:407] Connection header received
0806 10:41:50.246173 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:50.246179 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:50.246265 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:50.246436 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:50.247651 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.248880 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.250194 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.250865 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.250998 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.254259 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:50.254267 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:50.254271 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:50.254307 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:50.257619 (+ 3312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:50.258358 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:50.258372 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:50.258377 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:50.258565 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:50.258964 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:50.258970 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:50.258973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:50.259336 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:50.259492 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:50.259915 (+ 423us) server_negotiation.cc:299] Negotiation successful
0806 10:41:50.260149 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":373,"threads_started":1}
I20260806 10:41:50.265765 28201 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:48600:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 10:41:50.267186 28201 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:50.274857 28409 tablet_service.cc:1467] Processing CreateTablet for tablet 7b630919ca234eb3a7fa75836b721c41 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7c4e2d4b24aa4981a04b7f0ecc084edd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 10:41:50.275476 28409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b630919ca234eb3a7fa75836b721c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:50.275491 28628 tablet_service.cc:1467] Processing CreateTablet for tablet 7b630919ca234eb3a7fa75836b721c41 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7c4e2d4b24aa4981a04b7f0ecc084edd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 10:41:50.276052 28628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b630919ca234eb3a7fa75836b721c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:50.279194 28832 tablet_service.cc:1467] Processing CreateTablet for tablet 7b630919ca234eb3a7fa75836b721c41 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7c4e2d4b24aa4981a04b7f0ecc084edd]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 10:41:50.279803 28832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b630919ca234eb3a7fa75836b721c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:50.283411 28969 tablet_bootstrap.cc:492] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: Bootstrap starting.
I20260806 10:41:50.285194 28969 tablet_bootstrap.cc:654] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:50.290689 28969 tablet_bootstrap.cc:492] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: No bootstrap required, opened a new log
I20260806 10:41:50.291383 28971 tablet_bootstrap.cc:492] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb: Bootstrap starting.
I20260806 10:41:50.292374 28969 ts_tablet_manager.cc:1397] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.005s
I20260806 10:41:50.292932 28967 tablet_bootstrap.cc:492] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220: Bootstrap starting.
I20260806 10:41:50.293175 28971 tablet_bootstrap.cc:654] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:50.293416 28969 raft_consensus.cc:348] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.294709 28967 tablet_bootstrap.cc:654] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:50.295269 28969 raft_consensus.cc:374] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:50.295456 28969 raft_consensus.cc:729] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb82ce164e4c44b69e679430ef6c54d9, State: Initialized, Role: FOLLOWER
I20260806 10:41:50.295802 28969 consensus_queue.cc:260] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.296373 28978 tablet_replica.cc:439] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } } }
I20260806 10:41:50.296648 28978 tablet_replica.cc:442] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:50.299844 28969 ts_tablet_manager.cc:1428] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260806 10:41:50.307078 28967 tablet_bootstrap.cc:492] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220: No bootstrap required, opened a new log
I20260806 10:41:50.307080 28971 tablet_bootstrap.cc:492] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb: No bootstrap required, opened a new log
I20260806 10:41:50.307266 28967 ts_tablet_manager.cc:1397] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.003s
I20260806 10:41:50.307272 28971 ts_tablet_manager.cc:1397] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.005s
I20260806 10:41:50.307904 28967 raft_consensus.cc:348] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.308105 28967 raft_consensus.cc:374] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:50.308182 28967 raft_consensus.cc:729] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2fd3f3c7f2453fbe046c076dce2220, State: Initialized, Role: FOLLOWER
I20260806 10:41:50.308071 28971 raft_consensus.cc:348] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.308317 28971 raft_consensus.cc:374] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:50.308418 28971 raft_consensus.cc:729] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f00535193bf473f9d252c05bbf12feb, State: Initialized, Role: FOLLOWER
I20260806 10:41:50.308461 28967 consensus_queue.cc:260] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.308715 28971 consensus_queue.cc:260] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.308923 28976 tablet_replica.cc:439] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } } }
I20260806 10:41:50.309294 28976 tablet_replica.cc:442] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:50.309206 28979 tablet_replica.cc:439] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } } }
I20260806 10:41:50.309387 28971 ts_tablet_manager.cc:1428] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 10:41:50.309520 28979 tablet_replica.cc:442] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:50.310278 28967 ts_tablet_manager.cc:1428] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260806 10:41:50.382758 28978 raft_consensus.cc:482] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:50.382980 28978 raft_consensus.cc:504] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.383637 28978 leader_election.cc:288] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895), 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027)
I20260806 10:41:50.384291 28658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b630919ca234eb3a7fa75836b721c41" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" is_pre_election: true
I20260806 10:41:50.384357 28862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b630919ca234eb3a7fa75836b721c41" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f00535193bf473f9d252c05bbf12feb" is_pre_election: true
I20260806 10:41:50.384580 28862 raft_consensus.cc:2454] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 0.
I20260806 10:41:50.384603 28658 raft_consensus.cc:2454] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 0.
I20260806 10:41:50.385037 28335 leader_election.cc:302] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f00535193bf473f9d252c05bbf12feb, cb82ce164e4c44b69e679430ef6c54d9; no voters:
I20260806 10:41:50.385303 28978 raft_consensus.cc:2781] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:50.385452 28978 raft_consensus.cc:482] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:50.385545 28978 raft_consensus.cc:3037] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:50.388777 28978 raft_consensus.cc:504] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.389482 28978 leader_election.cc:288] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 election: Requested vote from peers 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895), 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027)
I20260806 10:41:50.390023 28658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b630919ca234eb3a7fa75836b721c41" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2fd3f3c7f2453fbe046c076dce2220"
I20260806 10:41:50.390148 28862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b630919ca234eb3a7fa75836b721c41" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f00535193bf473f9d252c05bbf12feb"
I20260806 10:41:50.390283 28658 raft_consensus.cc:3037] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:50.390424 28862 raft_consensus.cc:3037] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:50.393294 28658 raft_consensus.cc:2454] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 1.
I20260806 10:41:50.393311 28862 raft_consensus.cc:2454] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 1.
I20260806 10:41:50.393985 28335 leader_election.cc:302] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f00535193bf473f9d252c05bbf12feb, cb82ce164e4c44b69e679430ef6c54d9; no voters:
I20260806 10:41:50.394285 28978 raft_consensus.cc:2781] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:50.394521 28978 raft_consensus.cc:686] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 LEADER]: Becoming Leader. State: Replica: cb82ce164e4c44b69e679430ef6c54d9, State: Running, Role: LEADER
I20260806 10:41:50.394821 28978 consensus_queue.cc:237] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.396528 28992 tablet_replica.cc:439] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: TxnStatusTablet state changed. Reason: New leader cb82ce164e4c44b69e679430ef6c54d9. Latest consensus state: current_term: 1 leader_uuid: "cb82ce164e4c44b69e679430ef6c54d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } } }
I20260806 10:41:50.396859 28992 tablet_replica.cc:442] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: This TxnStatusTablet replica's current role is: LEADER
I20260806 10:41:50.398028 28197 catalog_manager.cc:5495] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb82ce164e4c44b69e679430ef6c54d9 (127.16.45.65). New cstate: current_term: 1 leader_uuid: "cb82ce164e4c44b69e679430ef6c54d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } health_report { overall_health: UNKNOWN } } }
I20260806 10:41:50.408443 29027 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 10:41:50.408691 29027 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 10:41:50.432336 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.426537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38551 (local address 127.0.0.1:32796)
0806 10:41:50.426791 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:50.426813 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:50.426956 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:50.427390 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:50.427394 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:50.427407 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 10:41:50.427600 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:50.427609 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.429067 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.429071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:50.430078 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:50.430091 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.431090 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.431097 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:50.431328 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.431415 (+ 87us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 10:41:50.431858 (+ 443us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 10:41:50.431880 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 10:41:50.431949 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 10:41:50.432080 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 10:41:50.432350 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.426564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32796 (local address 127.16.45.65:38551)
0806 10:41:50.426747 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:50.426754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:50.426889 (+ 135us) server_negotiation.cc:407] Connection header received
0806 10:41:50.427147 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:50.427153 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:50.427243 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:50.427341 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:50.427745 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.428894 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.430224 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.430904 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.431028 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.431600 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:50.431761 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:50.431863 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:50.431983 (+ 120us) server_negotiation.cc:299] Negotiation successful
0806 10:41:50.432067 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 10:41:50.436877 28658 raft_consensus.cc:1261] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Refusing update from remote peer cb82ce164e4c44b69e679430ef6c54d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:50.436906 28862 raft_consensus.cc:1261] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Refusing update from remote peer cb82ce164e4c44b69e679430ef6c54d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:50.437515 28978 consensus_queue.cc:1035] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:50.437875 28992 consensus_queue.cc:1035] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:50.445900 28979 tablet_replica.cc:439] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb: TxnStatusTablet state changed. Reason: New leader cb82ce164e4c44b69e679430ef6c54d9. Latest consensus state: current_term: 1 leader_uuid: "cb82ce164e4c44b69e679430ef6c54d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } } }
I20260806 10:41:50.446219 28979 tablet_replica.cc:442] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:50.448943 29029 mvcc.cc:205] Tried to move back new op lower bound from 7315508881142599680 to 7315508880980000768. Current Snapshot: MvccSnapshot[applied={T|T < 7315508881142599680}]
I20260806 10:41:50.454965 28992 tablet_replica.cc:439] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb82ce164e4c44b69e679430ef6c54d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } } }
I20260806 10:41:50.455637 28992 tablet_replica.cc:442] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: This TxnStatusTablet replica's current role is: LEADER
I20260806 10:41:50.456697 28976 tablet_replica.cc:439] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220: TxnStatusTablet state changed. Reason: New leader cb82ce164e4c44b69e679430ef6c54d9. Latest consensus state: current_term: 1 leader_uuid: "cb82ce164e4c44b69e679430ef6c54d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } } }
I20260806 10:41:50.457036 28976 tablet_replica.cc:442] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:50.458873 28979 tablet_replica.cc:439] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb82ce164e4c44b69e679430ef6c54d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } } }
I20260806 10:41:50.459194 28979 tablet_replica.cc:442] T 7b630919ca234eb3a7fa75836b721c41 P 9f00535193bf473f9d252c05bbf12feb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:50.459942 28992 tablet_replica.cc:439] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb82ce164e4c44b69e679430ef6c54d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } } }
I20260806 10:41:50.464097 28992 tablet_replica.cc:442] T 7b630919ca234eb3a7fa75836b721c41 P cb82ce164e4c44b69e679430ef6c54d9: This TxnStatusTablet replica's current role is: LEADER
I20260806 10:41:50.473394 28976 tablet_replica.cc:439] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb82ce164e4c44b69e679430ef6c54d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } } }
I20260806 10:41:50.473686 28976 tablet_replica.cc:442] T 7b630919ca234eb3a7fa75836b721c41 P 3a2fd3f3c7f2453fbe046c076dce2220: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 10:41:50.483179 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.473111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44424 (local address 127.16.45.67:42027)
0806 10:41:50.476724 (+ 3613us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:50.476731 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:50.477131 (+ 400us) server_negotiation.cc:407] Connection header received
0806 10:41:50.477348 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:50.477352 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:50.477451 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:50.477600 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:50.478162 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.478979 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.480904 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.481339 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.481434 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.481947 (+ 513us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:50.482573 (+ 626us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:50.482684 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:50.482806 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 10:41:50.482876 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3468,"thread_start_us":3342,"threads_started":1}
I20260806 10:41:50.499958 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.494157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:54857 (local address 127.16.45.65:38551)
0806 10:41:50.494397 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:50.494404 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:50.494875 (+ 471us) server_negotiation.cc:407] Connection header received
0806 10:41:50.495068 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:50.495073 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:50.495155 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:50.495243 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:50.495731 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.496562 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.498121 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.498656 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.498787 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.499196 (+ 409us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:50.499315 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:50.499391 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:50.499521 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 10:41:50.499610 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 10:41:50.500025 29050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.494087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38551 (local address 127.16.45.67:54857)
0806 10:41:50.494751 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:50.494768 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:50.494933 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:50.495279 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:50.495284 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:50.495297 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 10:41:50.495581 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:50.495591 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.496722 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.496728 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:50.497967 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:50.497994 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.498831 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.498838 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:50.498964 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.499023 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 10:41:50.499409 (+ 386us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 10:41:50.499421 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 10:41:50.499490 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 10:41:50.499640 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":348,"threads_started":1}
I20260806 10:41:50.510335 28658 raft_consensus.cc:1261] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Refusing update from remote peer 9f00535193bf473f9d252c05bbf12feb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:50.510547 28446 raft_consensus.cc:1261] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Refusing update from remote peer 9f00535193bf473f9d252c05bbf12feb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:50.511037 29010 consensus_queue.cc:1035] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:50.511700 28979 consensus_queue.cc:1035] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:50.556212 29059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.539602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:42027 (local address 127.16.45.65:48749)
0806 10:41:50.550456 (+ 10854us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:50.550476 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:50.550659 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:50.551160 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:50.551165 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:50.551178 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 10:41:50.551589 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:50.551600 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.552854 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.552859 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:50.554007 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:50.554020 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.554893 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.554900 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:50.555101 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.555178 (+ 77us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 10:41:50.555630 (+ 452us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 10:41:50.555647 (+ 17us) client_negotiation.cc:769] Sending connection context
0806 10:41:50.555731 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 10:41:50.555882 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10603,"thread_start_us":11150,"threads_started":1}
I20260806 10:41:50.556195 29043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.539758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:48749 (local address 127.16.45.67:42027)
0806 10:41:50.539932 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:50.539939 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:50.550563 (+ 10624us) server_negotiation.cc:407] Connection header received
0806 10:41:50.550813 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:50.550819 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:50.550909 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:50.551008 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:50.551775 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.552726 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.554151 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.554706 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.554839 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.555360 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:50.555491 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:50.555578 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:50.555778 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 10:41:50.555865 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 10:41:50.609272 28197 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48592:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:50.609625 28197 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48592:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:50.613245 28197 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c: Sending DeleteTablet for 3 replicas of tablet 14723230f5664147a7beca8230d4274d
I20260806 10:41:50.614152 28409 tablet_service.cc:1514] Processing DeleteTablet for tablet 14723230f5664147a7beca8230d4274d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:50 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:32782
I20260806 10:41:50.614513 28628 tablet_service.cc:1514] Processing DeleteTablet for tablet 14723230f5664147a7beca8230d4274d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:50 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:47722
I20260806 10:41:50.615228 29063 tablet_replica.cc:330] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220: stopping tablet replica
I20260806 10:41:50.615351 28832 tablet_service.cc:1514] Processing DeleteTablet for tablet 14723230f5664147a7beca8230d4274d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:50 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:44422
I20260806 10:41:50.615455 29063 raft_consensus.cc:2229] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:50.615748 29063 raft_consensus.cc:2258] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:50.616437 29065 tablet_replica.cc:330] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9: stopping tablet replica
I20260806 10:41:50.616647 29065 raft_consensus.cc:2229] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:50.616945 29065 raft_consensus.cc:2258] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:50.617911 29063 ts_tablet_manager.cc:1905] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:50.625926 29063 ts_tablet_manager.cc:1918] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:41:50.626106 29063 log.cc:1196] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/14723230f5664147a7beca8230d4274d
I20260806 10:41:50.626724 29063 ts_tablet_manager.cc:1939] T 14723230f5664147a7beca8230d4274d P 3a2fd3f3c7f2453fbe046c076dce2220: Deleting consensus metadata
I20260806 10:41:50.627039 29065 ts_tablet_manager.cc:1905] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:50.627981 28182 catalog_manager.cc:4841] TS 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895): tablet 14723230f5664147a7beca8230d4274d (table test-table [id=8e20874c965242dca2961b9d610a29e8]) successfully deleted
I20260806 10:41:50.640822 29065 ts_tablet_manager.cc:1918] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:41:50.641990 29065 log.cc:1196] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/14723230f5664147a7beca8230d4274d
I20260806 10:41:50.650205 29065 ts_tablet_manager.cc:1939] T 14723230f5664147a7beca8230d4274d P cb82ce164e4c44b69e679430ef6c54d9: Deleting consensus metadata
I20260806 10:41:50.650265 29064 tablet_replica.cc:330] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb: stopping tablet replica
I20260806 10:41:50.650497 29064 raft_consensus.cc:2229] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:41:50.651293 29064 raft_consensus.cc:2258] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:50.652657 28184 catalog_manager.cc:4841] TS cb82ce164e4c44b69e679430ef6c54d9 (127.16.45.65:38551): tablet 14723230f5664147a7beca8230d4274d (table test-table [id=8e20874c965242dca2961b9d610a29e8]) successfully deleted
I20260806 10:41:50.653386 29064 ts_tablet_manager.cc:1905] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:50.661325 29064 ts_tablet_manager.cc:1918] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:41:50.661484 29064 log.cc:1196] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/14723230f5664147a7beca8230d4274d
I20260806 10:41:50.661965 29064 ts_tablet_manager.cc:1939] T 14723230f5664147a7beca8230d4274d P 9f00535193bf473f9d252c05bbf12feb: Deleting consensus metadata
I20260806 10:41:50.663151 28182 catalog_manager.cc:4841] TS 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027): tablet 14723230f5664147a7beca8230d4274d (table test-table [id=8e20874c965242dca2961b9d610a29e8]) successfully deleted
Aug 06 10:41:50 dist-test-slave-fgb3 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 10:41:50 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:41:50 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 10:41:50.717418 29019 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:41:50.706779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48614 (local address 127.16.45.126:37983)
0806 10:41:50.707010 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:50.707018 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:50.707403 (+ 385us) server_negotiation.cc:407] Connection header received
0806 10:41:50.707587 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:50.707593 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:50.707693 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:50.707783 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:50.709126 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.709867 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.711190 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.711652 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.711776 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.717199 (+ 5423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48614: BlockingRecv error: recv got EOF from 127.0.0.1:48614 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 10:41:50 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM
I20260806 10:41:50.736016 29019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:50.721434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48620 (local address 127.16.45.126:37983)
0806 10:41:50.721627 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:50.721634 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:50.722086 (+ 452us) server_negotiation.cc:407] Connection header received
0806 10:41:50.722261 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:50.722268 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:50.722419 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:50.722515 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:50.723903 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.724739 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.726249 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:50.726826 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:50.726947 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:50.730720 (+ 3773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:50.730725 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:50.730728 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:50.730775 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:50.733278 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:50.733934 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:50.733939 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:50.733942 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:50.734091 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:50.734556 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:50.734560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:50.734562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:50.734847 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:50.735106 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:50.735409 (+ 303us) server_negotiation.cc:299] Negotiation successful
0806 10:41:50.735653 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 10:41:50.740212 28197 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48620:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:41:50.740856 28197 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:50.748176 28409 tablet_service.cc:1467] Processing CreateTablet for tablet adec12e518b14b8dbfd602240159482b (DEFAULT_TABLE table=test-table [id=b88e8e2b23aa424d9e5b5fbd6eea9b58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:50.748695 28409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adec12e518b14b8dbfd602240159482b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:50.748627 28832 tablet_service.cc:1467] Processing CreateTablet for tablet adec12e518b14b8dbfd602240159482b (DEFAULT_TABLE table=test-table [id=b88e8e2b23aa424d9e5b5fbd6eea9b58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:50.748688 28628 tablet_service.cc:1467] Processing CreateTablet for tablet adec12e518b14b8dbfd602240159482b (DEFAULT_TABLE table=test-table [id=b88e8e2b23aa424d9e5b5fbd6eea9b58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:50.749075 28832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adec12e518b14b8dbfd602240159482b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:50.749145 28628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adec12e518b14b8dbfd602240159482b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:50.756047 28971 tablet_bootstrap.cc:492] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb: Bootstrap starting.
I20260806 10:41:50.756171 28969 tablet_bootstrap.cc:492] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9: Bootstrap starting.
I20260806 10:41:50.757758 28969 tablet_bootstrap.cc:654] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:50.757822 28971 tablet_bootstrap.cc:654] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:50.758846 28967 tablet_bootstrap.cc:492] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220: Bootstrap starting.
I20260806 10:41:50.760149 28967 tablet_bootstrap.cc:654] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:50.763669 28969 tablet_bootstrap.cc:492] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9: No bootstrap required, opened a new log
I20260806 10:41:50.763855 28969 ts_tablet_manager.cc:1397] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260806 10:41:50.764776 28969 raft_consensus.cc:348] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.765183 28969 raft_consensus.cc:374] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:50.765303 28969 raft_consensus.cc:729] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb82ce164e4c44b69e679430ef6c54d9, State: Initialized, Role: FOLLOWER
I20260806 10:41:50.765643 28969 consensus_queue.cc:260] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.766914 28969 ts_tablet_manager.cc:1428] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:50.776301 28967 tablet_bootstrap.cc:492] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220: No bootstrap required, opened a new log
I20260806 10:41:50.776482 28967 ts_tablet_manager.cc:1397] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.003s
I20260806 10:41:50.777257 28967 raft_consensus.cc:348] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.777498 28967 raft_consensus.cc:374] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:50.777603 28967 raft_consensus.cc:729] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2fd3f3c7f2453fbe046c076dce2220, State: Initialized, Role: FOLLOWER
I20260806 10:41:50.777876 28967 consensus_queue.cc:260] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.778585 28967 ts_tablet_manager.cc:1428] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260806 10:41:50.780177 28971 tablet_bootstrap.cc:492] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb: No bootstrap required, opened a new log
I20260806 10:41:50.780365 28971 ts_tablet_manager.cc:1397] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb: Time spent bootstrapping tablet: real 0.024s user 0.009s sys 0.000s
I20260806 10:41:50.781296 28971 raft_consensus.cc:348] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.781649 28971 raft_consensus.cc:374] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:50.781777 28971 raft_consensus.cc:729] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f00535193bf473f9d252c05bbf12feb, State: Initialized, Role: FOLLOWER
I20260806 10:41:50.782063 28971 consensus_queue.cc:260] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:50.782729 28971 ts_tablet_manager.cc:1428] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 10:41:51.185390 29056 raft_consensus.cc:482] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:51.185593 29056 raft_consensus.cc:504] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:51.186216 29056 leader_election.cc:288] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895), 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027)
I20260806 10:41:51.186965 28657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adec12e518b14b8dbfd602240159482b" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" is_pre_election: true
I20260806 10:41:51.187047 28862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adec12e518b14b8dbfd602240159482b" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f00535193bf473f9d252c05bbf12feb" is_pre_election: true
I20260806 10:41:51.187206 28657 raft_consensus.cc:2454] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 0.
I20260806 10:41:51.187290 28862 raft_consensus.cc:2454] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 0.
I20260806 10:41:51.187812 28335 leader_election.cc:302] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2fd3f3c7f2453fbe046c076dce2220, cb82ce164e4c44b69e679430ef6c54d9; no voters:
I20260806 10:41:51.188131 29056 raft_consensus.cc:2781] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:51.188299 29056 raft_consensus.cc:482] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:51.188416 29056 raft_consensus.cc:3037] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:51.191104 29056 raft_consensus.cc:504] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:51.191651 29056 leader_election.cc:288] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 election: Requested vote from peers 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895), 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027)
I20260806 10:41:51.192233 28657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adec12e518b14b8dbfd602240159482b" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2fd3f3c7f2453fbe046c076dce2220"
I20260806 10:41:51.192286 28862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adec12e518b14b8dbfd602240159482b" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f00535193bf473f9d252c05bbf12feb"
I20260806 10:41:51.192440 28657 raft_consensus.cc:3037] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:51.192478 28862 raft_consensus.cc:3037] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:51.194468 28657 raft_consensus.cc:2454] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 1.
I20260806 10:41:51.194476 28862 raft_consensus.cc:2454] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 1.
I20260806 10:41:51.194892 28335 leader_election.cc:302] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f00535193bf473f9d252c05bbf12feb, cb82ce164e4c44b69e679430ef6c54d9; no voters:
I20260806 10:41:51.195376 29056 raft_consensus.cc:2781] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:51.195719 29056 raft_consensus.cc:686] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 1 LEADER]: Becoming Leader. State: Replica: cb82ce164e4c44b69e679430ef6c54d9, State: Running, Role: LEADER
I20260806 10:41:51.195966 29056 consensus_queue.cc:237] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:51.198541 28201 catalog_manager.cc:5495] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb82ce164e4c44b69e679430ef6c54d9 (127.16.45.65). New cstate: current_term: 1 leader_uuid: "cb82ce164e4c44b69e679430ef6c54d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } health_report { overall_health: UNKNOWN } } }
I20260806 10:41:51.230512 29091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:51.225204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32812 (local address 127.16.45.65:38551)
0806 10:41:51.225728 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:51.225734 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:51.225751 (+ 17us) server_negotiation.cc:407] Connection header received
0806 10:41:51.225822 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:51.225826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:51.225889 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:51.225975 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:51.226495 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:51.227203 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:51.228701 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:51.229120 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:51.229222 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:51.229708 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:51.229826 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:51.229900 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:51.230023 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 10:41:51.230093 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":235,"threads_started":1}
I20260806 10:41:51.233600 28862 raft_consensus.cc:1261] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Refusing update from remote peer cb82ce164e4c44b69e679430ef6c54d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:51.233666 28657 raft_consensus.cc:1261] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Refusing update from remote peer cb82ce164e4c44b69e679430ef6c54d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:51.234225 29056 consensus_queue.cc:1035] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:51.234746 29088 consensus_queue.cc:1035] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:51.247360 28201 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:51.247601 28201 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:51.250347 28201 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c: Sending DeleteTablet for 3 replicas of tablet adec12e518b14b8dbfd602240159482b
I20260806 10:41:51.251072 28409 tablet_service.cc:1514] Processing DeleteTablet for tablet adec12e518b14b8dbfd602240159482b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:51 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:32782
I20260806 10:41:51.251292 28628 tablet_service.cc:1514] Processing DeleteTablet for tablet adec12e518b14b8dbfd602240159482b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:51 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:47722
I20260806 10:41:51.251379 28832 tablet_service.cc:1514] Processing DeleteTablet for tablet adec12e518b14b8dbfd602240159482b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:51 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:44422
I20260806 10:41:51.252553 28201 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48620:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:41:51.253300 28201 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:41:51.261399 28411 tablet_service.cc:1467] Processing CreateTablet for tablet ac607ffa5bba4ad6b44c70b174d896e3 (DEFAULT_TABLE table=test-table [id=d5a4f907bfc64378967f63cd1e41d9bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:51.261763 28833 tablet_service.cc:1467] Processing CreateTablet for tablet ac607ffa5bba4ad6b44c70b174d896e3 (DEFAULT_TABLE table=test-table [id=d5a4f907bfc64378967f63cd1e41d9bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:51.261983 28411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac607ffa5bba4ad6b44c70b174d896e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:51.262332 28833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac607ffa5bba4ad6b44c70b174d896e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:51.262738 29104 tablet_replica.cc:330] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220: stopping tablet replica
I20260806 10:41:51.262931 29104 raft_consensus.cc:2229] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:51.263190 29104 raft_consensus.cc:2258] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:51.266414 29104 ts_tablet_manager.cc:1905] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:51.267596 28628 tablet_service.cc:1467] Processing CreateTablet for tablet ac607ffa5bba4ad6b44c70b174d896e3 (DEFAULT_TABLE table=test-table [id=d5a4f907bfc64378967f63cd1e41d9bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:41:51.268150 28628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac607ffa5bba4ad6b44c70b174d896e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:51.271585 28971 tablet_bootstrap.cc:492] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb: Bootstrap starting.
I20260806 10:41:51.273439 28971 tablet_bootstrap.cc:654] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:51.274041 29103 tablet_replica.cc:330] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9: stopping tablet replica
I20260806 10:41:51.274235 29103 raft_consensus.cc:2229] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:41:51.274577 28969 tablet_bootstrap.cc:492] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9: Bootstrap starting.
I20260806 10:41:51.274643 29103 raft_consensus.cc:2258] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:51.275629 29103 ts_tablet_manager.cc:1905] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:51.276170 28969 tablet_bootstrap.cc:654] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:51.282377 29103 ts_tablet_manager.cc:1918] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:51.282516 29103 log.cc:1196] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/adec12e518b14b8dbfd602240159482b
I20260806 10:41:51.282959 29103 ts_tablet_manager.cc:1939] T adec12e518b14b8dbfd602240159482b P cb82ce164e4c44b69e679430ef6c54d9: Deleting consensus metadata
I20260806 10:41:51.284169 28184 catalog_manager.cc:4841] TS cb82ce164e4c44b69e679430ef6c54d9 (127.16.45.65:38551): tablet adec12e518b14b8dbfd602240159482b (table test-table [id=b88e8e2b23aa424d9e5b5fbd6eea9b58]) successfully deleted
I20260806 10:41:51.285007 29105 tablet_replica.cc:330] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb: stopping tablet replica
I20260806 10:41:51.285228 29105 raft_consensus.cc:2229] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:51.285526 29105 raft_consensus.cc:2258] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:51.286607 29105 ts_tablet_manager.cc:1905] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:51.286949 28969 tablet_bootstrap.cc:492] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9: No bootstrap required, opened a new log
I20260806 10:41:51.287106 28969 ts_tablet_manager.cc:1397] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.001s
I20260806 10:41:51.287693 28969 raft_consensus.cc:348] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:51.287904 28969 raft_consensus.cc:374] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:51.287981 28969 raft_consensus.cc:729] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb82ce164e4c44b69e679430ef6c54d9, State: Initialized, Role: FOLLOWER
I20260806 10:41:51.288211 28969 consensus_queue.cc:260] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:51.288836 28969 ts_tablet_manager.cc:1428] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 10:41:51.293968 29105 ts_tablet_manager.cc:1918] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:51.294191 29105 log.cc:1196] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/adec12e518b14b8dbfd602240159482b
I20260806 10:41:51.294775 29105 ts_tablet_manager.cc:1939] T adec12e518b14b8dbfd602240159482b P 9f00535193bf473f9d252c05bbf12feb: Deleting consensus metadata
I20260806 10:41:51.296069 28182 catalog_manager.cc:4841] TS 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027): tablet adec12e518b14b8dbfd602240159482b (table test-table [id=b88e8e2b23aa424d9e5b5fbd6eea9b58]) successfully deleted
I20260806 10:41:51.298085 29104 ts_tablet_manager.cc:1918] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:41:51.298218 29104 log.cc:1196] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/adec12e518b14b8dbfd602240159482b
I20260806 10:41:51.306438 29108 tablet_bootstrap.cc:492] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220: Bootstrap starting.
I20260806 10:41:51.306627 28971 tablet_bootstrap.cc:492] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb: No bootstrap required, opened a new log
I20260806 10:41:51.306811 28971 ts_tablet_manager.cc:1397] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.004s
I20260806 10:41:51.307551 28971 raft_consensus.cc:348] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:51.307806 28971 raft_consensus.cc:374] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:51.307899 28971 raft_consensus.cc:729] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f00535193bf473f9d252c05bbf12feb, State: Initialized, Role: FOLLOWER
I20260806 10:41:51.307933 29108 tablet_bootstrap.cc:654] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:51.308133 28971 consensus_queue.cc:260] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:51.308739 28971 ts_tablet_manager.cc:1428] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 10:41:51.309124 29104 ts_tablet_manager.cc:1939] T adec12e518b14b8dbfd602240159482b P 3a2fd3f3c7f2453fbe046c076dce2220: Deleting consensus metadata
I20260806 10:41:51.310252 28182 catalog_manager.cc:4841] TS 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895): tablet adec12e518b14b8dbfd602240159482b (table test-table [id=b88e8e2b23aa424d9e5b5fbd6eea9b58]) successfully deleted
I20260806 10:41:51.316059 29108 tablet_bootstrap.cc:492] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220: No bootstrap required, opened a new log
I20260806 10:41:51.316224 29108 ts_tablet_manager.cc:1397] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.002s
I20260806 10:41:51.317044 29108 raft_consensus.cc:348] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:51.317293 29108 raft_consensus.cc:374] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:51.317400 29108 raft_consensus.cc:729] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2fd3f3c7f2453fbe046c076dce2220, State: Initialized, Role: FOLLOWER
I20260806 10:41:51.317647 29108 consensus_queue.cc:260] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:51.318254 29108 ts_tablet_manager.cc:1428] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260806 10:41:51.430850 29088 raft_consensus.cc:482] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:41:51.431134 29088 raft_consensus.cc:504] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:51.431876 29088 leader_election.cc:288] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895), 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027)
I20260806 10:41:51.432552 28657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac607ffa5bba4ad6b44c70b174d896e3" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" is_pre_election: true
I20260806 10:41:51.432657 28862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac607ffa5bba4ad6b44c70b174d896e3" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f00535193bf473f9d252c05bbf12feb" is_pre_election: true
I20260806 10:41:51.432799 28657 raft_consensus.cc:2454] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 0.
I20260806 10:41:51.432955 28862 raft_consensus.cc:2454] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 0.
I20260806 10:41:51.433233 28335 leader_election.cc:302] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2fd3f3c7f2453fbe046c076dce2220, cb82ce164e4c44b69e679430ef6c54d9; no voters:
I20260806 10:41:51.433552 29088 raft_consensus.cc:2781] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:41:51.433653 29088 raft_consensus.cc:482] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:41:51.433784 29088 raft_consensus.cc:3037] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:51.436156 29088 raft_consensus.cc:504] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:51.436751 29088 leader_election.cc:288] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 election: Requested vote from peers 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895), 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027)
I20260806 10:41:51.437346 28657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac607ffa5bba4ad6b44c70b174d896e3" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2fd3f3c7f2453fbe046c076dce2220"
I20260806 10:41:51.437412 28862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac607ffa5bba4ad6b44c70b174d896e3" candidate_uuid: "cb82ce164e4c44b69e679430ef6c54d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f00535193bf473f9d252c05bbf12feb"
I20260806 10:41:51.437587 28657 raft_consensus.cc:3037] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:51.437657 28862 raft_consensus.cc:3037] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:51.439879 28657 raft_consensus.cc:2454] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 1.
I20260806 10:41:51.439905 28862 raft_consensus.cc:2454] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb82ce164e4c44b69e679430ef6c54d9 in term 1.
I20260806 10:41:51.440297 28335 leader_election.cc:302] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2fd3f3c7f2453fbe046c076dce2220, cb82ce164e4c44b69e679430ef6c54d9; no voters:
I20260806 10:41:51.440574 29088 raft_consensus.cc:2781] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:51.440752 29088 raft_consensus.cc:686] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 LEADER]: Becoming Leader. State: Replica: cb82ce164e4c44b69e679430ef6c54d9, State: Running, Role: LEADER
I20260806 10:41:51.441004 29088 consensus_queue.cc:237] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } }
I20260806 10:41:51.443632 28201 catalog_manager.cc:5495] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb82ce164e4c44b69e679430ef6c54d9 (127.16.45.65). New cstate: current_term: 1 leader_uuid: "cb82ce164e4c44b69e679430ef6c54d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb82ce164e4c44b69e679430ef6c54d9" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 } health_report { overall_health: UNKNOWN } } }
I20260806 10:41:51.499475 29091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:51.494456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:48695 (local address 127.16.45.65:38551)
0806 10:41:51.494665 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:51.494674 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:51.494949 (+ 275us) server_negotiation.cc:407] Connection header received
0806 10:41:51.495079 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:51.495083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:51.495142 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:51.495212 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:41:51.495649 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:51.496347 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:51.497691 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:51.498207 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:51.498299 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:51.498745 (+ 446us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:41:51.498843 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:41:51.498906 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:51.499095 (+ 189us) server_negotiation.cc:299] Negotiation successful
0806 10:41:51.499187 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":71}
I20260806 10:41:51.499519 29119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:51.494256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38551 (local address 127.16.45.65:48695)
0806 10:41:51.494857 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:51.494873 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:51.494987 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:51.495227 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:51.495230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:51.495238 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 10:41:51.495530 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:51.495538 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:51.496496 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:51.496501 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:51.497564 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:51.497576 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:51.498438 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:51.498443 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:51.498567 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:51.498604 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 10:41:51.498942 (+ 338us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 10:41:51.498953 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 10:41:51.499025 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 10:41:51.499130 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":13,"thread_start_us":353,"threads_started":1}
I20260806 10:41:51.507104 28862 raft_consensus.cc:1261] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Refusing update from remote peer cb82ce164e4c44b69e679430ef6c54d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:51.507103 28657 raft_consensus.cc:1261] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Refusing update from remote peer cb82ce164e4c44b69e679430ef6c54d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:41:51.507614 29113 consensus_queue.cc:1035] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2fd3f3c7f2453fbe046c076dce2220" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:51.507906 29056 consensus_queue.cc:1035] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f00535193bf473f9d252c05bbf12feb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:41:51.555378 28201 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:51.555605 28201 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:41:51.558653 28201 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ecddba99efa54ca8bbcb997598167b3c: Sending DeleteTablet for 3 replicas of tablet ac607ffa5bba4ad6b44c70b174d896e3
I20260806 10:41:51.559475 28411 tablet_service.cc:1514] Processing DeleteTablet for tablet ac607ffa5bba4ad6b44c70b174d896e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:51 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:32782
I20260806 10:41:51.559574 28628 tablet_service.cc:1514] Processing DeleteTablet for tablet ac607ffa5bba4ad6b44c70b174d896e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:51 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:47722
I20260806 10:41:51.559768 29103 tablet_replica.cc:330] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9: stopping tablet replica
I20260806 10:41:51.559974 29103 raft_consensus.cc:2229] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:41:51.559964 28832 tablet_service.cc:1514] Processing DeleteTablet for tablet ac607ffa5bba4ad6b44c70b174d896e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:41:51 UTC) from {username='oryx', principal='oryx/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:44422
I20260806 10:41:51.560263 29104 tablet_replica.cc:330] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220: stopping tablet replica
I20260806 10:41:51.560313 29103 raft_consensus.cc:2258] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:51.560473 29104 raft_consensus.cc:2229] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:51.560688 29104 raft_consensus.cc:2258] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:51.560931 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 28308
I20260806 10:41:51.560971 29105 tablet_replica.cc:330] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb: stopping tablet replica
I20260806 10:41:51.561161 29105 raft_consensus.cc:2229] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:41:51.561369 29105 raft_consensus.cc:2258] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:41:51.561605 29103 ts_tablet_manager.cc:1905] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:51.563369 29104 ts_tablet_manager.cc:1905] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:51.568326 29103 ts_tablet_manager.cc:1918] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:41:51.568511 29103 log.cc:1196] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/ac607ffa5bba4ad6b44c70b174d896e3
I20260806 10:41:51.568931 29103 ts_tablet_manager.cc:1939] T ac607ffa5bba4ad6b44c70b174d896e3 P cb82ce164e4c44b69e679430ef6c54d9: Deleting consensus metadata
I20260806 10:41:51.570111 29104 ts_tablet_manager.cc:1918] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:41:51.570113 28184 catalog_manager.cc:4841] TS cb82ce164e4c44b69e679430ef6c54d9 (127.16.45.65:38551): tablet ac607ffa5bba4ad6b44c70b174d896e3 (table test-table [id=d5a4f907bfc64378967f63cd1e41d9bd]) successfully deleted
I20260806 10:41:51.570158 29105 ts_tablet_manager.cc:1905] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:41:51.570278 29104 log.cc:1196] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/ac607ffa5bba4ad6b44c70b174d896e3
I20260806 10:41:51.570719 29104 ts_tablet_manager.cc:1939] T ac607ffa5bba4ad6b44c70b174d896e3 P 3a2fd3f3c7f2453fbe046c076dce2220: Deleting consensus metadata
I20260806 10:41:51.571642 28182 catalog_manager.cc:4841] TS 3a2fd3f3c7f2453fbe046c076dce2220 (127.16.45.66:38895): tablet ac607ffa5bba4ad6b44c70b174d896e3 (table test-table [id=d5a4f907bfc64378967f63cd1e41d9bd]) successfully deleted
I20260806 10:41:51.576021 29105 ts_tablet_manager.cc:1918] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 10:41:51.576191 29105 log.cc:1196] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/ac607ffa5bba4ad6b44c70b174d896e3
I20260806 10:41:51.576620 29105 ts_tablet_manager.cc:1939] T ac607ffa5bba4ad6b44c70b174d896e3 P 9f00535193bf473f9d252c05bbf12feb: Deleting consensus metadata
I20260806 10:41:51.577746 28182 catalog_manager.cc:4841] TS 9f00535193bf473f9d252c05bbf12feb (127.16.45.67:42027): tablet ac607ffa5bba4ad6b44c70b174d896e3 (table test-table [id=d5a4f907bfc64378967f63cd1e41d9bd]) successfully deleted
Aug 06 10:41:51 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.45.65@KRBTEST.COM
I20260806 10:41:51.585135 29091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:51.562208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32828 (local address 127.16.45.65:38551)
0806 10:41:51.562440 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:51.562447 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:51.569195 (+ 6748us) server_negotiation.cc:407] Connection header received
0806 10:41:51.569495 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:51.569502 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:51.569594 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:51.569684 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:51.571863 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:51.572619 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:51.574503 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:51.574940 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:51.575042 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:51.579804 (+ 4762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:51.579821 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:51.579840 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:51.579876 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:51.582784 (+ 2908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:51.583417 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:51.583425 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:51.583428 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:51.583574 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:51.583875 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:51.583879 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:51.583881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:51.584237 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:51.584493 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:51.584709 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 10:41:51.584883 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:41:51.585767 28516 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:51.734424 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 28308
I20260806 10:41:51.770350 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 28527
Aug 06 10:41:51 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.45.66@KRBTEST.COM
I20260806 10:41:51.785037 29128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:51.771201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47738 (local address 127.16.45.66:38895)
0806 10:41:51.771805 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:51.771809 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:51.771827 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:41:51.771885 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:51.771888 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:51.771950 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:51.772046 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:51.773281 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:51.774086 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:51.775394 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:51.775806 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:51.775901 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:51.779815 (+ 3914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:51.779832 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:51.779847 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:51.779890 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:51.782639 (+ 2749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:51.783280 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:51.783287 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:51.783289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:51.783451 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:51.783742 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:51.783745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:51.783748 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:51.784084 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:51.784306 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:51.784584 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 10:41:51.784771 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":325,"threads_started":1}
I20260806 10:41:51.785800 28724 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:51.881840 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 28527
I20260806 10:41:51.903618 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 28738
Aug 06 10:41:51 dist-test-slave-fgb3 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.45.67@KRBTEST.COM
I20260806 10:41:51.919286 29130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:51.904464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44434 (local address 127.16.45.67:42027)
0806 10:41:51.904943 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:51.904947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:51.904963 (+ 16us) server_negotiation.cc:407] Connection header received
0806 10:41:51.905015 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:51.905018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:51.905078 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:51.905174 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:51.906560 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:51.907256 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:51.908529 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:51.908971 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:51.909065 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:51.913745 (+ 4680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:51.913763 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:51.913780 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:51.913820 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:51.916691 (+ 2871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:51.917330 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:51.917340 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:51.917344 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:51.917501 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:51.917832 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:51.917835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:51.917837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:51.918211 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:51.918497 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:51.918748 (+ 251us) server_negotiation.cc:299] Negotiation successful
0806 10:41:51.918951 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":265,"threads_started":1}
I20260806 10:41:51.919945 28927 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:52.042184 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 28738
I20260806 10:41:52.067452 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 28154
I20260806 10:41:52.068650 28267 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:52.184885 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 28154
2026-08-06T10:41:52Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (8488 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:41:52 dist-test-slave-fgb3 krb5kdc[29138](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:41:52 dist-test-slave-fgb3 krb5kdc[29138](info): set up 2 sockets
Aug 06 10:41:52 dist-test-slave-fgb3 krb5kdc[29138](info): commencing operation
krb5kdc: starting...
W20260806 10:41:53.386902 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.008s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:41:53 dist-test-slave-fgb3 krb5kdc[29138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:41:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:41:53.646613 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:38127
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:39621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:38127
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:53.972770 29157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:53.973100 29157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:53.973237 29157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:53.980723 29157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:53.980841 29157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:53.980931 29157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:53.981017 29157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:53.981086 29157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:53.990691 29157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:39621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:38127
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:38127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:53.991966 29157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:53.993220 29157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:54.004632 29164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:54.004583 29165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:54.004604 29167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:54.005416 29157 server_base.cc:1034] running on GCE node
I20260806 10:41:54.006134 29157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:54.007561 29157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:54.008764 29157 hybrid_clock.cc:648] HybridClock initialized: now 1786012914008715 us; error 39 us; skew 500 ppm
I20260806 10:41:54.009089 29157 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T10:41:54Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1889 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:41:54 dist-test-slave-fgb3 krb5kdc[29179](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:41:54 dist-test-slave-fgb3 krb5kdc[29179](info): set up 2 sockets
Aug 06 10:41:54 dist-test-slave-fgb3 krb5kdc[29179](info): commencing operation
krb5kdc: starting...
W20260806 10:41:55.271051 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:41:55 dist-test-slave-fgb3 krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:41:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:41:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:41:55.534409 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:36645
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:42347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:36645
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:55.865770 29197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:55.866065 29197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:55.866185 29197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:55.873482 29197 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:55.873590 29197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:55.873656 29197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:55.873730 29197 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:55.873777 29197 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:55.883669 29197 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:36645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:36645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:55.884961 29197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:55.886261 29197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:55.902595 29207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:55.902701 29206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:55.902719 29209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:55.903362 29197 server_base.cc:1034] running on GCE node
I20260806 10:41:55.904204 29197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:55.905664 29197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:55.906867 29197 hybrid_clock.cc:648] HybridClock initialized: now 1786012915906810 us; error 41 us; skew 500 ppm
I20260806 10:41:55.907207 29197 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:55 dist-test-slave-fgb3 krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012915, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:55.910109 29197 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:41:55.911593 29197 webserver.cc:460] Webserver started at http://127.16.45.126:45971/ using document root <none> and password file <none>
I20260806 10:41:55.912246 29197 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:55.912358 29197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:55.912647 29197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:55.915548 29197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "5badfd940bde47d5979db82a2b562c23"
format_stamp: "Formatted at 2026-08-06 10:41:55 on dist-test-slave-fgb3"
server_key: "539c3a9259ad0f34c5483977b3b0d0b8"
server_key_iv: "0ad7f44d5f3e495d7a1b0ce067a62293"
server_key_version: "encryptionkey@0"
I20260806 10:41:55.916343 29197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "5badfd940bde47d5979db82a2b562c23"
format_stamp: "Formatted at 2026-08-06 10:41:55 on dist-test-slave-fgb3"
server_key: "539c3a9259ad0f34c5483977b3b0d0b8"
server_key_iv: "0ad7f44d5f3e495d7a1b0ce067a62293"
server_key_version: "encryptionkey@0"
I20260806 10:41:55.921784 29197 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:41:55.925284 29224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:55.926662 29197 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:55.926824 29197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "5badfd940bde47d5979db82a2b562c23"
format_stamp: "Formatted at 2026-08-06 10:41:55 on dist-test-slave-fgb3"
server_key: "539c3a9259ad0f34c5483977b3b0d0b8"
server_key_iv: "0ad7f44d5f3e495d7a1b0ce067a62293"
server_key_version: "encryptionkey@0"
I20260806 10:41:55.927006 29197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:55.967092 29197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:55.971463 29197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:55.971743 29197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:55.989660 29197 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:36645
I20260806 10:41:55.989671 29289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:36645 every 8 connection(s)
I20260806 10:41:55.991060 29197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:55.994904 29290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:41:56.000916 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 29197
I20260806 10:41:56.001142 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:41:56.001968 16565 external_mini_cluster.cc:1428] Setting key 79b610b87387251eef62135d999afa92
I20260806 10:41:56.006428 29290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23: Bootstrap starting.
I20260806 10:41:56.009514 29290 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23: Neither blocks nor log segments found. Creating new log.
I20260806 10:41:56.010596 29290 log.cc:824] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:56.013388 29290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23: No bootstrap required, opened a new log
Aug 06 10:41:56 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:56.022652 29290 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5badfd940bde47d5979db82a2b562c23" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36645 } }
I20260806 10:41:56.023131 29290 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:41:56.023240 29290 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5badfd940bde47d5979db82a2b562c23, State: Initialized, Role: FOLLOWER
I20260806 10:41:56.023890 29290 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5badfd940bde47d5979db82a2b562c23" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36645 } }
I20260806 10:41:56.024139 29290 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:56.024313 29290 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:56.024501 29290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:41:56.025799 29293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:56.004247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33498 (local address 127.16.45.126:36645)
0806 10:41:56.005067 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:56.005078 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:56.005119 (+ 41us) server_negotiation.cc:407] Connection header received
0806 10:41:56.006928 (+ 1809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:56.006952 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:56.007322 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:56.007695 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:56.009193 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:56.010576 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:56.012098 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:56.012755 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:56.012938 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:56.017429 (+ 4491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:56.017439 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:56.017456 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:56.017502 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:56.021145 (+ 3643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:56.022128 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:56.022136 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:56.022144 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:56.022392 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:56.022839 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:56.022843 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:56.022845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:56.023513 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:56.023813 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:56.024276 (+ 463us) server_negotiation.cc:299] Negotiation successful
0806 10:41:56.024727 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":360,"threads_started":1}
I20260806 10:41:56.027087 29290 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5badfd940bde47d5979db82a2b562c23" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36645 } }
I20260806 10:41:56.027570 29290 leader_election.cc:302] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5badfd940bde47d5979db82a2b562c23; no voters:
I20260806 10:41:56.028239 29290 leader_election.cc:288] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:41:56.028357 29295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:41:56.029037 29295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 1 LEADER]: Becoming Leader. State: Replica: 5badfd940bde47d5979db82a2b562c23, State: Running, Role: LEADER
I20260806 10:41:56.029680 29295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5badfd940bde47d5979db82a2b562c23" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36645 } }
I20260806 10:41:56.030862 29290 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:56.032671 29297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5badfd940bde47d5979db82a2b562c23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5badfd940bde47d5979db82a2b562c23" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36645 } } }
I20260806 10:41:56.032747 29301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5badfd940bde47d5979db82a2b562c23. Latest consensus state: current_term: 1 leader_uuid: "5badfd940bde47d5979db82a2b562c23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5badfd940bde47d5979db82a2b562c23" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36645 } } }
I20260806 10:41:56.033181 29297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:56.033202 29301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:56.038966 29305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:56.043382 29305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:56.052453 29305 catalog_manager.cc:1347] Generated new cluster ID: 9325591ece5b42a583792b79ee85e008
I20260806 10:41:56.052970 29305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:56.073307 29305 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:41:56.074687 29305 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:56.084430 29305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23: Generated new TSK 0
I20260806 10:41:56.085256 29305 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:41:56.153895 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36645
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:42347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:56.482736 29329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:56.483011 29329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:56.483143 29329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:56.490250 29329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:56.490389 29329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:56.490521 29329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:41:56.500191 29329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36645
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:56.501410 29329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:56.502728 29329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:56.515631 29336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:56.515563 29337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:56.515609 29339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:56.516378 29329 server_base.cc:1034] running on GCE node
I20260806 10:41:56.516999 29329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:56.517915 29329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:56.519125 29329 hybrid_clock.cc:648] HybridClock initialized: now 1786012916519068 us; error 49 us; skew 500 ppm
I20260806 10:41:56.519420 29329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:56 dist-test-slave-fgb3 krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012916, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:56.522528 29329 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:41:56.523865 29329 webserver.cc:460] Webserver started at http://127.16.45.65:40489/ using document root <none> and password file <none>
I20260806 10:41:56.524489 29329 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:56.524591 29329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:56.524849 29329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:56.527697 29329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "a8fbcdb324f345458fe84622bfe778c9"
format_stamp: "Formatted at 2026-08-06 10:41:56 on dist-test-slave-fgb3"
server_key: "e77d9ed573e84c804952e31d6c51577c"
server_key_iv: "e4285d75169050dd80c7a3aeef9ad9c8"
server_key_version: "encryptionkey@0"
I20260806 10:41:56.528482 29329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "a8fbcdb324f345458fe84622bfe778c9"
format_stamp: "Formatted at 2026-08-06 10:41:56 on dist-test-slave-fgb3"
server_key: "e77d9ed573e84c804952e31d6c51577c"
server_key_iv: "e4285d75169050dd80c7a3aeef9ad9c8"
server_key_version: "encryptionkey@0"
I20260806 10:41:56.533751 29329 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:41:56.537631 29348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:56.539055 29329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:56.539233 29329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "a8fbcdb324f345458fe84622bfe778c9"
format_stamp: "Formatted at 2026-08-06 10:41:56 on dist-test-slave-fgb3"
server_key: "e77d9ed573e84c804952e31d6c51577c"
server_key_iv: "e4285d75169050dd80c7a3aeef9ad9c8"
server_key_version: "encryptionkey@0"
I20260806 10:41:56.539443 29329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:56.560020 29329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:56.564679 29329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:56.564977 29329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:56.565923 29329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:56.567286 29329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:56.567358 29329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:56.567473 29329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:56.567526 29329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:56.597366 29329 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:41635
I20260806 10:41:56.597411 29515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:41635 every 8 connection(s)
I20260806 10:41:56.598680 29329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:41:56.601439 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 29329
I20260806 10:41:56.601660 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:41:56.602305 16565 external_mini_cluster.cc:1428] Setting key cd57b4ff59c266aa6378c937467b7d56
Aug 06 10:41:56 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012916, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:56.618966 29519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:56.601123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:45837 (local address 127.16.45.126:36645)
0806 10:41:56.601664 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:56.601670 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:56.602651 (+ 981us) server_negotiation.cc:407] Connection header received
0806 10:41:56.604872 (+ 2221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:56.604878 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:56.604958 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:56.605074 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:56.606544 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:56.607521 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:56.609028 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:56.609554 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:56.609676 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:56.613320 (+ 3644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:56.613326 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:56.613329 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:56.613361 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:56.615884 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:56.616605 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:56.616611 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:56.616614 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:56.616754 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:56.617125 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:56.617130 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:56.617134 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:56.617455 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:56.617613 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:56.618378 (+ 765us) server_negotiation.cc:299] Negotiation successful
0806 10:41:56.618624 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":286,"threads_started":1}
I20260806 10:41:56.620070 29520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:56.601649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:45837)
0806 10:41:56.602468 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:56.602522 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:56.604613 (+ 2091us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:56.605248 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:56.605256 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:56.605736 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:56.606298 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:56.606352 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:56.607649 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:56.607653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:56.608890 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:56.608901 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:56.609745 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:56.609749 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:56.609960 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:56.610625 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:56.610653 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:56.613097 (+ 2444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:56.616010 (+ 2913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:56.616017 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:56.616031 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:56.616479 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:56.616846 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:56.616849 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:56.616851 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:56.617023 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:56.617605 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:56.617612 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:56.617950 (+ 338us) client_negotiation.cc:769] Sending connection context
0806 10:41:56.618205 (+ 255us) client_negotiation.cc:240] Negotiation successful
0806 10:41:56.618683 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":303,"threads_started":1}
I20260806 10:41:56.621644 29516 heartbeater.cc:347] Connected to a master server at 127.16.45.126:36645
I20260806 10:41:56.622016 29516 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:56.622924 29516 heartbeater.cc:511] Master 127.16.45.126:36645 requested a full tablet report, sending...
I20260806 10:41:56.625324 29243 ts_manager.cc:194] Registered new tserver with Master: a8fbcdb324f345458fe84622bfe778c9 (127.16.45.65:41635)
I20260806 10:41:56.627388 29243 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:45837
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:41:56.665230 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36645
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:42347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:56.989746 29525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:56.989987 29525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:56.990101 29525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:56.997304 29525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:56.997421 29525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:56.997566 29525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:41:57.007277 29525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36645
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:57.008553 29525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:57.009859 29525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:57.022579 29535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:57.022766 29536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:57.022926 29538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:57.023635 29525 server_base.cc:1034] running on GCE node
I20260806 10:41:57.024410 29525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:57.025331 29525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:57.026523 29525 hybrid_clock.cc:648] HybridClock initialized: now 1786012917026469 us; error 45 us; skew 500 ppm
I20260806 10:41:57.026840 29525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:57 dist-test-slave-fgb3 krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012917, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:57.029930 29525 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:41:57.031518 29525 webserver.cc:460] Webserver started at http://127.16.45.66:39663/ using document root <none> and password file <none>
I20260806 10:41:57.032226 29525 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:57.032334 29525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:57.032640 29525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:57.035686 29525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "1f3c2228f5c341ac96cafe87dfd5b4cd"
format_stamp: "Formatted at 2026-08-06 10:41:57 on dist-test-slave-fgb3"
server_key: "3283e2127d5a06104d9702e794bdf8de"
server_key_iv: "90e2673cda87fc2010f25c7d11f66582"
server_key_version: "encryptionkey@0"
I20260806 10:41:57.036504 29525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "1f3c2228f5c341ac96cafe87dfd5b4cd"
format_stamp: "Formatted at 2026-08-06 10:41:57 on dist-test-slave-fgb3"
server_key: "3283e2127d5a06104d9702e794bdf8de"
server_key_iv: "90e2673cda87fc2010f25c7d11f66582"
server_key_version: "encryptionkey@0"
I20260806 10:41:57.041842 29525 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 10:41:57.045535 29549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:57.047005 29525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:41:57.047159 29525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "1f3c2228f5c341ac96cafe87dfd5b4cd"
format_stamp: "Formatted at 2026-08-06 10:41:57 on dist-test-slave-fgb3"
server_key: "3283e2127d5a06104d9702e794bdf8de"
server_key_iv: "90e2673cda87fc2010f25c7d11f66582"
server_key_version: "encryptionkey@0"
I20260806 10:41:57.047366 29525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:57.081553 29525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:57.085858 29525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:57.086123 29525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:57.087141 29525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:57.088514 29525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:57.088587 29525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:57.088706 29525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:57.088755 29525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:57.119136 29525 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:40845
I20260806 10:41:57.119185 29717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:40845 every 8 connection(s)
I20260806 10:41:57.120549 29525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:41:57.130981 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 29525
I20260806 10:41:57.131157 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:41:57.131629 16565 external_mini_cluster.cc:1428] Setting key 18a9c83857702c3a67bd28cdbe97d2f4
Aug 06 10:41:57 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012917, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:57.141650 29722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:57.123268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:51019 (local address 127.16.45.126:36645)
0806 10:41:57.123711 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:57.123715 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:57.124819 (+ 1104us) server_negotiation.cc:407] Connection header received
0806 10:41:57.126739 (+ 1920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:57.126745 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:57.126843 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:57.126947 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:57.128557 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:57.129273 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:57.131083 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:57.131583 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:57.131836 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:57.135844 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:57.135849 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:57.135853 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:57.135887 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:57.138552 (+ 2665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:57.139309 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:57.139313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:57.139315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:57.139442 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:57.139883 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:57.139886 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:57.139888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:57.140156 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:57.140294 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:57.141047 (+ 753us) server_negotiation.cc:299] Negotiation successful
0806 10:41:57.141279 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":225,"threads_started":1}
I20260806 10:41:57.142743 29723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:57.123813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:51019)
0806 10:41:57.124615 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:57.124661 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:57.126457 (+ 1796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:57.127211 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:57.127220 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:57.127773 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:57.128372 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:57.128391 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:57.129428 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:57.129432 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:57.130942 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:57.130958 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:57.131843 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:57.131851 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:57.132163 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:57.132995 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:57.133026 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:57.135575 (+ 2549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:57.138699 (+ 3124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:57.138709 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:57.138730 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:57.139173 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:57.139553 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:57.139558 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:57.139562 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:57.139760 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:57.140282 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:57.140290 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:57.140673 (+ 383us) client_negotiation.cc:769] Sending connection context
0806 10:41:57.140923 (+ 250us) client_negotiation.cc:240] Negotiation successful
0806 10:41:57.141516 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":309,"threads_started":1}
I20260806 10:41:57.144161 29720 heartbeater.cc:347] Connected to a master server at 127.16.45.126:36645
I20260806 10:41:57.144497 29720 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:57.145300 29720 heartbeater.cc:511] Master 127.16.45.126:36645 requested a full tablet report, sending...
I20260806 10:41:57.146938 29243 ts_manager.cc:194] Registered new tserver with Master: 1f3c2228f5c341ac96cafe87dfd5b4cd (127.16.45.66:40845)
I20260806 10:41:57.147994 29243 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:51019
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:41:57.189294 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36645
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:42347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:57.518121 29728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:57.518455 29728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:57.518563 29728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:57.526047 29728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:57.526165 29728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:57.526280 29728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:41:57.536165 29728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36645
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:57.537418 29728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:57.538870 29728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:57.552037 29735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:57.552098 29736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:57.552084 29738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:57.552812 29728 server_base.cc:1034] running on GCE node
I20260806 10:41:57.553484 29728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:57.554553 29728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:57.555766 29728 hybrid_clock.cc:648] HybridClock initialized: now 1786012917555709 us; error 50 us; skew 500 ppm
I20260806 10:41:57.556077 29728 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:57 dist-test-slave-fgb3 krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012917, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:57.559315 29728 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:41:57.560875 29728 webserver.cc:460] Webserver started at http://127.16.45.67:45729/ using document root <none> and password file <none>
I20260806 10:41:57.561568 29728 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:57.561688 29728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:57.561996 29728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:41:57.565068 29728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "9bf1534da45a43c393fef174728e509a"
format_stamp: "Formatted at 2026-08-06 10:41:57 on dist-test-slave-fgb3"
server_key: "0e6f4386ffaf52b4a82a22c7b8e37e5b"
server_key_iv: "292ea25da18d19f6d923dffbd54bccfc"
server_key_version: "encryptionkey@0"
I20260806 10:41:57.565863 29728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "9bf1534da45a43c393fef174728e509a"
format_stamp: "Formatted at 2026-08-06 10:41:57 on dist-test-slave-fgb3"
server_key: "0e6f4386ffaf52b4a82a22c7b8e37e5b"
server_key_iv: "292ea25da18d19f6d923dffbd54bccfc"
server_key_version: "encryptionkey@0"
I20260806 10:41:57.571172 29728 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260806 10:41:57.574767 29757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:57.576074 29728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 10:41:57.576233 29728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "9bf1534da45a43c393fef174728e509a"
format_stamp: "Formatted at 2026-08-06 10:41:57 on dist-test-slave-fgb3"
server_key: "0e6f4386ffaf52b4a82a22c7b8e37e5b"
server_key_iv: "292ea25da18d19f6d923dffbd54bccfc"
server_key_version: "encryptionkey@0"
I20260806 10:41:57.576428 29728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:57.599288 29728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:57.603540 29728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:57.603808 29728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:57.604768 29728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:57.606082 29728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:57.606160 29728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:57.606280 29728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:57.606351 29728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260806 10:41:57.631392 29516 heartbeater.cc:503] Master 127.16.45.126:36645 was elected leader, sending a full tablet report...
I20260806 10:41:57.638029 29728 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:40795
I20260806 10:41:57.638108 29929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:40795 every 8 connection(s)
I20260806 10:41:57.639307 29728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:41:57.645995 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 29728
I20260806 10:41:57.646150 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:41:57.646657 16565 external_mini_cluster.cc:1428] Setting key 244569acd585789e820008ed92c95471
Aug 06 10:41:57 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012917, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:41:57.659405 29722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:57.641884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:56257 (local address 127.16.45.126:36645)
0806 10:41:57.642064 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:57.642068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:57.643225 (+ 1157us) server_negotiation.cc:407] Connection header received
0806 10:41:57.645083 (+ 1858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:57.645089 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:57.645188 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:57.645278 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:57.646906 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:57.647778 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:57.649893 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:57.650392 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:57.650498 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:57.653948 (+ 3450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:57.653953 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:57.653957 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:57.653990 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:57.656491 (+ 2501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:57.657164 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:57.657167 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:57.657169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:57.657285 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:57.657750 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:57.657753 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:57.657755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:57.658045 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:57.658177 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:57.658973 (+ 796us) server_negotiation.cc:299] Negotiation successful
0806 10:41:57.659157 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:41:57.660315 29933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:57.642293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:56257)
0806 10:41:57.643061 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:57.643103 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:57.644812 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:57.645524 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:57.645534 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:57.646061 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:57.646723 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:57.646749 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:57.647961 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:57.647967 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:57.649714 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:57.649730 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:57.650616 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:57.650622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:57.650842 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:57.651516 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:57.651539 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:41:57.653746 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:41:57.656623 (+ 2877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:57.656631 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:57.656645 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:57.657072 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:57.657379 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:41:57.657382 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:41:57.657384 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:41:57.657563 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:41:57.658180 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:41:57.658189 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:41:57.658593 (+ 404us) client_negotiation.cc:769] Sending connection context
0806 10:41:57.658832 (+ 239us) client_negotiation.cc:240] Negotiation successful
0806 10:41:57.659238 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":283,"threads_started":1}
I20260806 10:41:57.661805 29931 heartbeater.cc:347] Connected to a master server at 127.16.45.126:36645
I20260806 10:41:57.662151 29931 heartbeater.cc:464] Registering TS with master...
I20260806 10:41:57.662932 29931 heartbeater.cc:511] Master 127.16.45.126:36645 requested a full tablet report, sending...
I20260806 10:41:57.664306 29242 ts_manager.cc:194] Registered new tserver with Master: 9bf1534da45a43c393fef174728e509a (127.16.45.67:40795)
I20260806 10:41:57.665166 29242 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:56257
I20260806 10:41:57.674949 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab.
Entry for principal oryx/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab.
WARNING: no policy specified for oryx/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab.
Entry for principal oryx/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab.
WARNING: no policy specified for oryx/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab.
Entry for principal oryx/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab.
I20260806 10:41:57.838035 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 29329
Aug 06 10:41:57 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:41:57.854449 29942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:57.839262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33012 (local address 127.16.45.65:41635)
0806 10:41:57.839966 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:57.839972 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:57.840002 (+ 30us) server_negotiation.cc:407] Connection header received
0806 10:41:57.840065 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:57.840072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:57.840285 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:57.840432 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:57.841813 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:57.843098 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:57.844390 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:57.844978 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:57.845075 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:57.848953 (+ 3878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:57.848965 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:57.848979 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:57.849012 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:57.851990 (+ 2978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:57.852622 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:57.852630 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:57.852632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:57.852774 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:57.853063 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:57.853066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:57.853068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:57.853418 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:57.853658 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:57.853841 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 10:41:57.854040 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":350,"threads_started":1}
I20260806 10:41:57.855718 29509 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:57.937409 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 29329
I20260806 10:41:57.957067 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 29525
Aug 06 10:41:57 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:41:57.972632 29944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:57.957940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47846 (local address 127.16.45.66:40845)
0806 10:41:57.958554 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:57.958561 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:57.958587 (+ 26us) server_negotiation.cc:407] Connection header received
0806 10:41:57.958646 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:57.958652 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:57.958871 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:57.958998 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:57.960341 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:57.961312 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:57.962740 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:57.963283 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:57.963376 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:57.967345 (+ 3969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:57.967357 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:57.967373 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:57.967407 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:57.970059 (+ 2652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:57.970750 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:57.970757 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:57.970760 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:57.970890 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:57.971162 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:57.971164 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:57.971166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:57.971534 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:57.971762 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:57.972048 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 10:41:57.972245 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":339,"threads_started":1}
I20260806 10:41:57.973894 29712 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:58.056676 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 29525
I20260806 10:41:58.078428 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 29728
Aug 06 10:41:58 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:41:58.094520 29947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:58.079580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59564 (local address 127.16.45.67:40795)
0806 10:41:58.080143 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:58.080150 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:58.080181 (+ 31us) server_negotiation.cc:407] Connection header received
0806 10:41:58.080242 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:58.080248 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:58.080462 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:58.080587 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:58.081933 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:58.083102 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:58.084353 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:58.084908 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:58.085003 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:58.089311 (+ 4308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:41:58.089325 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:41:58.089341 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:41:58.089414 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:41:58.092141 (+ 2727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:58.092747 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:58.092753 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:58.092756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:58.092878 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:41:58.093156 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:41:58.093159 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:41:58.093161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:41:58.093504 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:41:58.093724 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 10:41:58.093938 (+ 214us) server_negotiation.cc:299] Negotiation successful
0806 10:41:58.094147 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":273,"threads_started":1}
I20260806 10:41:58.095875 29924 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:58.177277 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 29728
I20260806 10:41:58.198498 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 29197
I20260806 10:41:58.199790 29285 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:41:58.304512 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 29197
I20260806 10:41:58.324193 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:36645
--webserver_interface=127.16.45.126
--webserver_port=45971
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:42347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:36645
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:41:58.665570 29950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:58.665879 29950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:58.666015 29950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:58.673354 29950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:41:58.673466 29950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:58.673539 29950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:58.673619 29950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:41:58.673677 29950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:41:58.684093 29950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:36645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:36645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=45971
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:58.685456 29950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:58.686791 29950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:58.698246 29958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:58.698249 29961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:58.698251 29959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:58.699180 29950 server_base.cc:1034] running on GCE node
I20260806 10:41:58.699965 29950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:58.701459 29950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:58.702672 29950 hybrid_clock.cc:648] HybridClock initialized: now 1786012918702621 us; error 38 us; skew 500 ppm
I20260806 10:41:58.703022 29950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:58 dist-test-slave-fgb3 krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012918, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:58.706060 29950 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:41:58.707573 29950 webserver.cc:460] Webserver started at http://127.16.45.126:45971/ using document root <none> and password file <none>
I20260806 10:41:58.708230 29950 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:58.708343 29950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:58.713639 29950 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 10:41:58.716984 29973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:58.718291 29950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 10:41:58.718499 29950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "5badfd940bde47d5979db82a2b562c23"
format_stamp: "Formatted at 2026-08-06 10:41:55 on dist-test-slave-fgb3"
server_key: "539c3a9259ad0f34c5483977b3b0d0b8"
server_key_iv: "0ad7f44d5f3e495d7a1b0ce067a62293"
server_key_version: "encryptionkey@0"
I20260806 10:41:58.719429 29950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:58.741787 29950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:58.745900 29950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:58.746167 29950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:58.763370 29950 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:36645
I20260806 10:41:58.763427 30055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:36645 every 8 connection(s)
I20260806 10:41:58.764827 29950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:41:58.769383 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 29950
I20260806 10:41:58.770161 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:41635
--local_ip_for_outbound_sockets=127.16.45.65
--tserver_master_addrs=127.16.45.126:36645
--webserver_port=40489
--webserver_interface=127.16.45.65
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:42347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.16.45.65
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:41:58.771776 30056 sys_catalog.cc:263] Verifying existing consensus state
I20260806 10:41:58.774928 30056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23: Bootstrap starting.
I20260806 10:41:58.798231 30056 log.cc:824] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23: Log is configured to *not* fsync() on all Append() calls
I20260806 10:41:58.809583 30056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 10:41:58.810200 30056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23: Bootstrap complete.
I20260806 10:41:58.823127 30056 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5badfd940bde47d5979db82a2b562c23" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36645 } }
I20260806 10:41:58.824275 30056 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5badfd940bde47d5979db82a2b562c23, State: Initialized, Role: FOLLOWER
I20260806 10:41:58.824970 30056 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5badfd940bde47d5979db82a2b562c23" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36645 } }
I20260806 10:41:58.825241 30056 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:41:58.825366 30056 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:41:58.825537 30056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 1 FOLLOWER]: Advancing to term 2
I20260806 10:41:58.831015 30056 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5badfd940bde47d5979db82a2b562c23" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36645 } }
I20260806 10:41:58.831614 30056 leader_election.cc:302] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5badfd940bde47d5979db82a2b562c23; no voters:
I20260806 10:41:58.832306 30056 leader_election.cc:288] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 10:41:58.832469 30064 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 10:41:58.833575 30064 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [term 2 LEADER]: Becoming Leader. State: Replica: 5badfd940bde47d5979db82a2b562c23, State: Running, Role: LEADER
I20260806 10:41:58.834120 30064 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5badfd940bde47d5979db82a2b562c23" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36645 } }
I20260806 10:41:58.834470 30056 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:41:58.836521 30066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5badfd940bde47d5979db82a2b562c23. Latest consensus state: current_term: 2 leader_uuid: "5badfd940bde47d5979db82a2b562c23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5badfd940bde47d5979db82a2b562c23" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36645 } } }
I20260806 10:41:58.836576 30065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5badfd940bde47d5979db82a2b562c23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5badfd940bde47d5979db82a2b562c23" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36645 } } }
I20260806 10:41:58.836899 30065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:58.836903 30066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23 [sys.catalog]: This master's current role is: LEADER
I20260806 10:41:58.849381 30071 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:41:58.859797 30071 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:41:58.861361 30071 catalog_manager.cc:1259] Loaded cluster ID: 9325591ece5b42a583792b79ee85e008
I20260806 10:41:58.861572 30071 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:41:58.865895 30071 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:41:58.867624 30071 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5badfd940bde47d5979db82a2b562c23: Loaded TSK: 0
I20260806 10:41:58.869336 30071 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 10:41:59.133065 30060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:59.133352 30060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:59.133466 30060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:59.141036 30060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:59.141155 30060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:59.141300 30060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:41:59.151352 30060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.65.keytab
--principal=oryx/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:41635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=40489
--tserver_master_addrs=127.16.45.126:36645
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:59.152689 30060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:59.154023 30060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:59.168538 30102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:59.168743 30100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:59.169126 30099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:59.170053 30060 server_base.cc:1034] running on GCE node
I20260806 10:41:59.170800 30060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:59.171957 30060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:59.173194 30060 hybrid_clock.cc:648] HybridClock initialized: now 1786012919173138 us; error 43 us; skew 500 ppm
I20260806 10:41:59.173573 30060 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:59 dist-test-slave-fgb3 krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012919, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:59.181197 30060 init.cc:377] Logged in from keytab as oryx/127.16.45.65@KRBTEST.COM (short username oryx)
I20260806 10:41:59.183177 30060 webserver.cc:460] Webserver started at http://127.16.45.65:40489/ using document root <none> and password file <none>
I20260806 10:41:59.184235 30060 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:59.184412 30060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:59.191665 30060 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 10:41:59.194983 30115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:59.196513 30060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:41:59.196671 30060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "a8fbcdb324f345458fe84622bfe778c9"
format_stamp: "Formatted at 2026-08-06 10:41:56 on dist-test-slave-fgb3"
server_key: "e77d9ed573e84c804952e31d6c51577c"
server_key_iv: "e4285d75169050dd80c7a3aeef9ad9c8"
server_key_version: "encryptionkey@0"
I20260806 10:41:59.197947 30060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:59.219203 30060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:59.223603 30060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:59.223868 30060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:59.224815 30060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:59.226125 30060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:59.226219 30060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:59.226302 30060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:59.226403 30060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260806 10:41:59.256942 30060 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:41635
I20260806 10:41:59.257000 30283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:41635 every 8 connection(s)
I20260806 10:41:59.258486 30060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:41:59.261844 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 30060
I20260806 10:41:59.262715 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:40845
--local_ip_for_outbound_sockets=127.16.45.66
--tserver_master_addrs=127.16.45.126:36645
--webserver_port=39663
--webserver_interface=127.16.45.66
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:42347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.16.45.66
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 10:41:59 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:41:59 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 10:41:59.602969 30290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:41:59.603264 30290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:41:59.603392 30290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:41:59.610639 30290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:41:59.610749 30290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:41:59.610911 30290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:41:59.620575 30290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.66.keytab
--principal=oryx/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:40845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=39663
--tserver_master_addrs=127.16.45.126:36645
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:41:59.621906 30290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:41:59.623301 30290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:41:59.638787 30298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:59.638983 30296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:41:59.639680 30300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:41:59.639966 30290 server_base.cc:1034] running on GCE node
I20260806 10:41:59.640591 30290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:41:59.641599 30290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:41:59.642804 30290 hybrid_clock.cc:648] HybridClock initialized: now 1786012919642764 us; error 33 us; skew 500 ppm
I20260806 10:41:59.643122 30290 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:41:59 dist-test-slave-fgb3 krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012919, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:41:59.646284 30290 init.cc:377] Logged in from keytab as oryx/127.16.45.66@KRBTEST.COM (short username oryx)
I20260806 10:41:59.647877 30290 webserver.cc:460] Webserver started at http://127.16.45.66:39663/ using document root <none> and password file <none>
I20260806 10:41:59.648551 30290 fs_manager.cc:359] Metadata directory not provided
I20260806 10:41:59.648677 30290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:41:59.653980 30290 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:41:59.656658 30309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:59.657946 30290 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 10:41:59.658103 30290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "1f3c2228f5c341ac96cafe87dfd5b4cd"
format_stamp: "Formatted at 2026-08-06 10:41:57 on dist-test-slave-fgb3"
server_key: "3283e2127d5a06104d9702e794bdf8de"
server_key_iv: "90e2673cda87fc2010f25c7d11f66582"
server_key_version: "encryptionkey@0"
I20260806 10:41:59.659060 30290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:41:59.693468 30290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:41:59.699525 30290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:41:59.699805 30290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:41:59.700843 30290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:41:59.702391 30290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:41:59.702486 30290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:59.702592 30290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:41:59.702672 30290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:41:59.744766 30290 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:40845
I20260806 10:41:59.744843 30482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:40845 every 8 connection(s)
I20260806 10:41:59.746420 30290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:41:59.755748 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 30290
I20260806 10:41:59.756461 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:40795
--local_ip_for_outbound_sockets=127.16.45.67
--tserver_master_addrs=127.16.45.126:36645
--webserver_port=45729
--webserver_interface=127.16.45.67
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:42347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.16.45.67
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 10:41:59 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:41:59 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 10:42:00.094812 30489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:00.095103 30489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:00.095232 30489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:00.102576 30489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:00.102700 30489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:00.102864 30489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:42:00.112589 30489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:42347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/krb5kdc/oryx_127.16.45.67.keytab
--principal=oryx/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:40795
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=45729
--tserver_master_addrs=127.16.45.126:36645
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:00.113869 30489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:00.115119 30489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:00.130146 30498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:00.130854 30497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:00.144374 30500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:00.145067 30489 server_base.cc:1034] running on GCE node
I20260806 10:42:00.146036 30489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:00.147548 30489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:00.148808 30489 hybrid_clock.cc:648] HybridClock initialized: now 1786012920148745 us; error 64 us; skew 500 ppm
I20260806 10:42:00.149243 30489 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:42:00 dist-test-slave-fgb3 krb5kdc[29179](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012920, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:42:00.154222 30489 init.cc:377] Logged in from keytab as oryx/127.16.45.67@KRBTEST.COM (short username oryx)
I20260806 10:42:00.157030 30489 webserver.cc:460] Webserver started at http://127.16.45.67:45729/ using document root <none> and password file <none>
I20260806 10:42:00.158176 30489 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:00.158402 30489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:00.167637 30489 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.006s sys 0.002s
I20260806 10:42:00.171767 30508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:00.173895 30489 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260806 10:42:00.174127 30489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "9bf1534da45a43c393fef174728e509a"
format_stamp: "Formatted at 2026-08-06 10:41:57 on dist-test-slave-fgb3"
server_key: "0e6f4386ffaf52b4a82a22c7b8e37e5b"
server_key_iv: "292ea25da18d19f6d923dffbd54bccfc"
server_key_version: "encryptionkey@0"
I20260806 10:42:00.175781 30489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:00.212096 30489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:00.218708 30489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:00.219056 30489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:00.223724 30489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:42:00.225901 30489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:42:00.226037 30489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:00.226162 30489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:42:00.226244 30489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:00.287933 30489 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:40795
I20260806 10:42:00.287997 30670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:40795 every 8 connection(s)
I20260806 10:42:00.290140 30489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:42:00.294943 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 30489
Aug 06 10:42:00 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:00 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:00.332755 30675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:00.296084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33502 (local address 127.16.45.126:36645)
0806 10:42:00.302753 (+ 6669us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:00.302759 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:00.314341 (+ 11582us) server_negotiation.cc:407] Connection header received
0806 10:42:00.314408 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:00.314414 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:00.314494 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:00.314617 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:00.316608 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.317929 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.319938 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.320561 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.320702 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:00.325716 (+ 5014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:00.325725 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:00.325741 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:42:00.325786 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:00.328810 (+ 3024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:00.329682 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:00.329689 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:00.329695 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:00.329862 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:00.330301 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:00.330306 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:00.330309 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:00.330818 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:00.331111 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:00.331561 (+ 450us) server_negotiation.cc:299] Negotiation successful
0806 10:42:00.332024 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6526,"thread_start_us":539,"threads_started":1}
W20260806 10:42:00.430135 30286 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.158s user 0.001s sys 0.011s
W20260806 10:42:00.431618 30289 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:41:59.261481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:35891 (local address 127.16.45.126:36645)
0806 10:41:59.264777 (+ 3296us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:59.264791 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:59.264844 (+ 53us) server_negotiation.cc:407] Connection header received
0806 10:41:59.265206 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:59.265219 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:59.265559 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:59.265895 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:59.267441 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:59.268661 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:59.270203 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:59.270918 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:59.271102 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:00.431267 (+1160165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:35891: BlockingRecv error: recv got EOF from 127.16.45.65:35891 (error 108)
Metrics: {"server-negotiator.queue_time_us":3081,"thread_start_us":2872,"threads_started":1}
I20260806 10:42:00.432103 30286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:59.261479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:35891)
0806 10:41:59.262277 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:59.262354 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:59.264098 (+ 1744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:59.266081 (+ 1983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:59.266093 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:59.266723 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:59.267243 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:59.267260 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:59.268831 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:59.268835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:59.270058 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:59.270071 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:59.271165 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:59.271172 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:59.271442 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:59.272077 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:59.272099 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:00.430959 (+1158860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":317,"threads_started":1}
W20260806 10:42:00.433527 30284 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:36645 (0 consecutive failures): Not authorized: Failed to ping master at 127.16.45.126:36645: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Aug 06 10:42:00 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:00 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:00.444392 30286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:00.434252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:38671)
0806 10:42:00.434852 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:00.434874 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:00.435024 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:00.435541 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:00.435545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:00.436007 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:00.436224 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:00.436238 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.438142 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.438147 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:00.439140 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:00.439153 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.439848 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.439855 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:00.440007 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:00.440664 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:00.440681 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:00.444089 (+ 3408us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":3231,"threads_started":1}
W20260806 10:42:00.444550 30289 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:00.434663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:38671 (local address 127.16.45.126:36645)
0806 10:42:00.434815 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:00.434821 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:00.434943 (+ 122us) server_negotiation.cc:407] Connection header received
0806 10:42:00.435153 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:00.435158 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:00.435233 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:00.435320 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:00.437012 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.438002 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.439278 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.439677 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.439784 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:00.444307 (+ 4523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:38671: BlockingRecv error: recv got EOF from 127.16.45.65:38671 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 06 10:42:00 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:00 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:00.454023 30286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:00.445334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:60003)
0806 10:42:00.445712 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:00.445730 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:00.445843 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:00.446130 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:00.446135 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:00.446506 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:00.446655 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:00.446664 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.447754 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.447759 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:00.449133 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:00.449148 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.449851 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.449857 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:00.450026 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:00.450610 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:00.450627 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:00.453758 (+ 3131us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":281}
W20260806 10:42:00.454193 30289 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:00.445553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:60003 (local address 127.16.45.126:36645)
0806 10:42:00.445708 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:00.445713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:00.445777 (+ 64us) server_negotiation.cc:407] Connection header received
0806 10:42:00.445948 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:00.445954 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:00.446019 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:00.446095 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:00.446784 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.447581 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.449294 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.449713 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.449818 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:00.453969 (+ 4151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:60003: BlockingRecv error: recv got EOF from 127.16.45.65:60003 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 10:42:00.454599 30284 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 10:42:00.933151 30488 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.173s user 0.000s sys 0.015s
W20260806 10:42:00.934665 30487 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:41:59.749284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:36663 (local address 127.16.45.126:36645)
0806 10:41:59.749929 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0806 10:41:59.749936 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:41:59.750909 (+ 973us) server_negotiation.cc:407] Connection header received
0806 10:41:59.752825 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:41:59.752831 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:41:59.752925 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:41:59.753066 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:41:59.754684 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:59.755990 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:59.758221 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:41:59.758966 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:41:59.759114 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:00.934434 (+1175320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:36663: BlockingRecv error: recv got EOF from 127.16.45.66:36663 (error 108)
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":312,"threads_started":1}
I20260806 10:42:00.935631 30488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:41:59.749786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:36663)
0806 10:41:59.750731 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0806 10:41:59.750795 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 10:41:59.752554 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:41:59.753287 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:41:59.753296 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:41:59.753865 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:41:59.754518 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:59.754539 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:59.756171 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:59.756177 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:59.758052 (+ 1875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:41:59.758069 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:41:59.759222 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:41:59.759229 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:41:59.759502 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:41:59.760386 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:41:59.760415 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:00.934259 (+1173844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":353,"threads_started":1}
W20260806 10:42:00.936668 30484 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:36645 (0 consecutive failures): Not authorized: Failed to ping master at 127.16.45.126:36645: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Aug 06 10:42:00 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:00 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:00.947638 30488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:00.937287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:38767)
0806 10:42:00.937515 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:00.937539 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:00.937711 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:00.938037 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:00.938043 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:00.938611 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:00.938894 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:00.938907 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.939886 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.939893 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:00.941571 (+ 1678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:00.941589 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.942302 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.942309 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:00.942524 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:00.943200 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:00.943226 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:00.947425 (+ 4199us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":65}
W20260806 10:42:00.947999 30487 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:00.937416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:38767 (local address 127.16.45.126:36645)
0806 10:42:00.937552 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:00.937556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:00.937630 (+ 74us) server_negotiation.cc:407] Connection header received
0806 10:42:00.937830 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:00.937834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:00.937905 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:00.937994 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:00.939027 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.939761 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.941718 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.942134 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.942224 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:00.947706 (+ 5482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:38767: BlockingRecv error: recv got EOF from 127.16.45.66:38767 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 06 10:42:00 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:00 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:00.957494 30488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:00.948280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:35283)
0806 10:42:00.948616 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:00.948630 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:00.948707 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:00.949010 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:00.949013 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:00.949300 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:00.949450 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:00.949458 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.951025 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.951029 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:00.951968 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:00.951980 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.952897 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.952901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:00.953040 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:00.953630 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:00.953646 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:00.957221 (+ 3575us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247}
W20260806 10:42:00.957767 30484 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 10:42:00.958098 30487 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:00.948475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:35283 (local address 127.16.45.126:36645)
0806 10:42:00.948657 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:00.948664 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:00.948686 (+ 22us) server_negotiation.cc:407] Connection header received
0806 10:42:00.948801 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:00.948807 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:00.948887 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:00.948992 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:00.949606 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.950892 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.952087 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.952754 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.952887 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:00.957440 (+ 4553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:35283: BlockingRecv error: recv got EOF from 127.16.45.66:35283 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260806 10:42:01.370504 30674 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.043s user 0.009s sys 0.009s
W20260806 10:42:01.371621 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:00.295660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:57023 (local address 127.16.45.126:36645)
0806 10:42:00.296693 (+ 1033us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:00.296701 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:00.310469 (+ 13768us) server_negotiation.cc:407] Connection header received
0806 10:42:00.313588 (+ 3119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:00.313594 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:00.313693 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:00.313771 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:00.320436 (+ 6665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.321725 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.325432 (+ 3707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.326140 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.326246 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:01.371410 (+1045164us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:57023: BlockingRecv error: recv got EOF from 127.16.45.67:57023 (error 108)
Metrics: {"server-negotiator.queue_time_us":874,"thread_start_us":6865,"threads_started":1}
I20260806 10:42:01.372092 30674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:00.293914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:57023)
0806 10:42:00.310229 (+ 16315us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:00.310287 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:00.313228 (+ 2941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:00.314463 (+ 1235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:00.314477 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:00.317315 (+ 2838us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:00.320178 (+ 2863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:00.320210 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.322946 (+ 2736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.322952 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:00.325259 (+ 2307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:00.325276 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:00.326655 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:00.326662 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:00.326989 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:00.327806 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:00.327845 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:01.371194 (+1043349us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":15955,"thread_start_us":15692,"threads_started":1}
W20260806 10:42:01.373010 30672 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:36645 (0 consecutive failures): Not authorized: Failed to ping master at 127.16.45.126:36645: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Aug 06 10:42:01 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:01 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:01.382153 30674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:01.373579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:34657)
0806 10:42:01.373781 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:01.373802 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:01.373933 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:01.374231 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:01.374236 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:01.374632 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:01.374801 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:01.374824 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.375836 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.375840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:01.377028 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:01.377040 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.377836 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.377842 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:01.378004 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:01.378559 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:01.378576 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:01.381939 (+ 3363us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":69}
W20260806 10:42:01.382378 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:01.373681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:34657 (local address 127.16.45.126:36645)
0806 10:42:01.373847 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:01.373853 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:01.373872 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:42:01.374050 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:01.374054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:01.374113 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:01.374192 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:01.374953 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.375699 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.377156 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.377658 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.377773 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:01.382123 (+ 4350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:34657: BlockingRecv error: recv got EOF from 127.16.45.67:34657 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 10:42:01 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:01 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:01.390615 30674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:01.382732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:45685)
0806 10:42:01.382874 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:01.382888 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:01.382969 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:01.383351 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:01.383356 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:01.383656 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:01.383797 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:01.383805 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.384776 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.384779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:01.385698 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:01.385709 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.386493 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.386499 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:01.386661 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:01.387113 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:01.387129 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:01.390426 (+ 3297us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 10:42:01.390832 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:01.382850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:45685 (local address 127.16.45.126:36645)
0806 10:42:01.383104 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:01.383109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:01.383124 (+ 15us) server_negotiation.cc:407] Connection header received
0806 10:42:01.383159 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:01.383162 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:01.383224 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:01.383300 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:01.383933 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.384643 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.385826 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.386357 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.386470 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:01.390595 (+ 4125us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:45685: BlockingRecv error: recv got EOF from 127.16.45.67:45685 (error 108)
Metrics: {"server-negotiator.queue_time_us":146}
W20260806 10:42:01.390858 30672 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 10:42:01 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:01 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:01.464143 30681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:01.455207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:55543)
0806 10:42:01.455725 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:01.455742 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:01.455858 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:01.456146 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:01.456149 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:01.456568 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:01.456717 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:01.456726 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.457783 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.457786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:01.458764 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:01.458776 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.459535 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.459540 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:01.459661 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:01.460229 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:01.460246 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:01.463912 (+ 3666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":310,"threads_started":1}
W20260806 10:42:01.464396 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:01.455271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:55543 (local address 127.16.45.126:36645)
0806 10:42:01.455439 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:01.455443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:01.455824 (+ 381us) server_negotiation.cc:407] Connection header received
0806 10:42:01.455958 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:01.455962 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:01.456027 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:01.456107 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:01.456893 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.457660 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.458907 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.459362 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.459468 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:01.464137 (+ 4669us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:55543: BlockingRecv error: recv got EOF from 127.16.45.65:55543 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 10:42:01 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:01 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:01.967643 30685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:01.958422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:53665)
0806 10:42:01.958952 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:01.958969 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:01.959091 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:01.959433 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:01.959437 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:01.959882 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:01.960033 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:01.960041 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.961125 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.961129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:01.962115 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:01.962129 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.962945 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.962950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:01.963075 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:01.963640 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:01.963663 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:01.967407 (+ 3744us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":290,"threads_started":1}
W20260806 10:42:01.967814 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:01.958479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:53665 (local address 127.16.45.126:36645)
0806 10:42:01.958684 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:01.958692 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:01.959047 (+ 355us) server_negotiation.cc:407] Connection header received
0806 10:42:01.959193 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:01.959198 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:01.959264 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:01.959373 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:01.960185 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.960964 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.962227 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:01.962776 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:01.962871 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:01.967606 (+ 4735us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:53665: BlockingRecv error: recv got EOF from 127.16.45.66:53665 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 10:42:02 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:02 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:02.400504 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:02.391514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:52167)
0806 10:42:02.392102 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:02.392119 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:02.392244 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:02.392577 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:02.392580 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:02.393013 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:02.393173 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:02.393181 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:02.394183 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:02.394187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:02.395232 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:02.395246 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:02.396099 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:02.396107 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:02.396262 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:02.396845 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:02.396877 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:02.400256 (+ 3379us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":341,"threads_started":1}
W20260806 10:42:02.400696 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:02.391662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:52167 (local address 127.16.45.126:36645)
0806 10:42:02.391827 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:02.391831 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:02.392192 (+ 361us) server_negotiation.cc:407] Connection header received
0806 10:42:02.392360 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:02.392370 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:02.392452 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:02.392528 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:02.393299 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:02.394041 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:02.395381 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:02.395906 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:02.396018 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:02.400479 (+ 4461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:52167: BlockingRecv error: recv got EOF from 127.16.45.67:52167 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 06 10:42:02 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:02 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:02.474124 30689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:02.465143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:40543)
0806 10:42:02.465626 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:02.465643 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:02.465765 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:02.466073 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:02.466077 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:02.466531 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:02.466795 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:02.466810 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:02.467837 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:02.467843 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:02.468898 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:02.468913 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:02.469697 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:02.469703 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:02.469891 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:02.470507 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:02.470525 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:02.473768 (+ 3243us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":269,"threads_started":1}
W20260806 10:42:02.474260 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:02.465223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:40543 (local address 127.16.45.126:36645)
0806 10:42:02.465489 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:02.465495 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:02.465717 (+ 222us) server_negotiation.cc:407] Connection header received
0806 10:42:02.465867 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:02.465872 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:02.465937 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:02.466020 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:02.466938 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:02.467687 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:02.469051 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:02.469543 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:02.469667 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:02.474013 (+ 4346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:40543: BlockingRecv error: recv got EOF from 127.16.45.65:40543 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 06 10:42:02 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:02 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:02.977035 30690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:02.968531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:51819)
0806 10:42:02.969108 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:02.969128 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:02.969255 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:02.969586 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:02.969590 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:02.969988 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:02.970174 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:02.970184 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:02.971200 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:02.971206 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:02.972107 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:02.972119 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:02.972802 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:02.972808 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:02.972984 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:02.973520 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:02.973537 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:02.976772 (+ 3235us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":346,"threads_started":1}
W20260806 10:42:02.977150 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:02.968578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:51819 (local address 127.16.45.126:36645)
0806 10:42:02.968762 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:02.968768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:02.969204 (+ 436us) server_negotiation.cc:407] Connection header received
0806 10:42:02.969378 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:02.969384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:02.969457 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:02.969534 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:02.970347 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:02.971060 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:02.972243 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:02.972655 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:02.972760 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:02.976967 (+ 4207us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:51819: BlockingRecv error: recv got EOF from 127.16.45.66:51819 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 06 10:42:03 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:03 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:03.410909 30691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:03.401479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:43015)
0806 10:42:03.402002 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:03.402023 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:03.402183 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:03.402568 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:03.402574 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:03.403090 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:03.403292 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:03.403302 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:03.404378 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:03.404384 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:03.405422 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:03.405438 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:03.406141 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:03.406147 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:03.406370 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:03.407035 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:03.407061 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:03.410554 (+ 3493us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":276,"threads_started":1}
W20260806 10:42:03.411026 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:03.401728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:43015 (local address 127.16.45.126:36645)
0806 10:42:03.401973 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:03.401980 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:03.402108 (+ 128us) server_negotiation.cc:407] Connection header received
0806 10:42:03.402335 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:03.402340 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:03.402425 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:03.402512 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:03.403443 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:03.404249 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:03.405561 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:03.405982 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:03.406117 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:03.410779 (+ 4662us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:43015: BlockingRecv error: recv got EOF from 127.16.45.67:43015 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 06 10:42:03 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:03 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:03.484345 30692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:03.475207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:57695)
0806 10:42:03.475740 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:03.475756 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:03.475886 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:03.476174 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:03.476177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:03.476527 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:03.476690 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:03.476698 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:03.477706 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:03.477710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:03.478716 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:03.478730 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:03.479463 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:03.479469 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:03.479664 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:03.480288 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:03.480311 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:03.484017 (+ 3706us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":307,"threads_started":1}
W20260806 10:42:03.484517 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:03.475291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:57695 (local address 127.16.45.126:36645)
0806 10:42:03.475475 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:03.475480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:03.475821 (+ 341us) server_negotiation.cc:407] Connection header received
0806 10:42:03.476004 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:03.476008 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:03.476069 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:03.476144 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:03.476796 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:03.477564 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:03.478829 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:03.479300 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:03.479419 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:03.484271 (+ 4852us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:57695: BlockingRecv error: recv got EOF from 127.16.45.65:57695 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 06 10:42:03 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:03 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:03.987093 30693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:03.977924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:42267)
0806 10:42:03.978484 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:03.978500 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:03.978617 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:03.978945 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:03.978949 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:03.979326 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:03.979506 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:03.979516 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:03.980625 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:03.980629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:03.981574 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:03.981612 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:03.982299 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:03.982303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:03.982507 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:03.983087 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:03.983105 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:03.986819 (+ 3714us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":296,"threads_started":1}
W20260806 10:42:03.987244 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:03.978027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:42267 (local address 127.16.45.126:36645)
0806 10:42:03.978185 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:03.978189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:03.978577 (+ 388us) server_negotiation.cc:407] Connection header received
0806 10:42:03.978709 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:03.978713 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:03.978778 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:03.978860 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:03.979669 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:03.980463 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:03.981758 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:03.982182 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:03.982273 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:03.987030 (+ 4757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:42267: BlockingRecv error: recv got EOF from 127.16.45.66:42267 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 06 10:42:04 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:04 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:04.428186 30695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:04.411972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:48513)
0806 10:42:04.412484 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:04.412500 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:04.412622 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:04.413004 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:04.413008 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:04.413400 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:04.413599 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:04.413608 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:04.414641 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:04.414646 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:04.415721 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:04.415735 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:04.416552 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:04.416558 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:04.416743 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:04.423975 (+ 7232us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:04.424009 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:04.427829 (+ 3820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":265,"threads_started":1}
W20260806 10:42:04.428402 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:04.412151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:48513 (local address 127.16.45.126:36645)
0806 10:42:04.412372 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:04.412377 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:04.412585 (+ 208us) server_negotiation.cc:407] Connection header received
0806 10:42:04.412718 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:04.412722 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:04.412804 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:04.412903 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:04.413762 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:04.414511 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:04.415884 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:04.416403 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:04.416506 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:04.428093 (+ 11587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:48513: BlockingRecv error: recv got EOF from 127.16.45.67:48513 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 10:42:04 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:04 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:04.494288 30696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:04.485356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:40325)
0806 10:42:04.485842 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:04.485858 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:04.485992 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:04.486268 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:04.486271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:04.486690 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:04.486855 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:04.486883 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:04.487929 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:04.487933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:04.488980 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:04.488996 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:04.489890 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:04.489898 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:04.490036 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:04.490713 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:04.490731 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:04.494036 (+ 3305us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":266,"threads_started":1}
W20260806 10:42:04.494529 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:04.485428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:40325 (local address 127.16.45.126:36645)
0806 10:42:04.485690 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:04.485696 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:04.485956 (+ 260us) server_negotiation.cc:407] Connection header received
0806 10:42:04.486089 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:04.486093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:04.486156 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:04.486235 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:04.487020 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:04.487790 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:04.489133 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:04.489709 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:04.489845 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:04.494246 (+ 4401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:40325: BlockingRecv error: recv got EOF from 127.16.45.65:40325 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 06 10:42:04 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:04 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:04.996754 30700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:04.988081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:51637)
0806 10:42:04.988643 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:04.988659 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:04.988771 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:04.989109 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:04.989114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:04.989519 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:04.989688 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:04.989698 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:04.990694 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:04.990698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:04.991691 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:04.991704 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:04.992407 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:04.992413 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:04.992564 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:04.993116 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:04.993138 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:04.996415 (+ 3277us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":336,"threads_started":1}
W20260806 10:42:04.996878 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:04.988188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:51637 (local address 127.16.45.126:36645)
0806 10:42:04.988403 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:04.988410 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:04.988763 (+ 353us) server_negotiation.cc:407] Connection header received
0806 10:42:04.988860 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:04.988865 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:04.988946 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:04.989053 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:04.989810 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:04.990566 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:04.991812 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:04.992229 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:04.992322 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:04.996642 (+ 4320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:51637: BlockingRecv error: recv got EOF from 127.16.45.66:51637 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 10:42:05 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:05 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:05.438423 30702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:05.429462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:35263)
0806 10:42:05.430036 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:05.430057 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:05.430199 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:05.430591 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:05.430595 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:05.430987 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:05.431151 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:05.431160 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:05.432113 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:05.432116 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:05.433103 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:05.433115 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:05.433745 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:05.433750 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:05.433894 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:05.434603 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:05.434622 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:05.438100 (+ 3478us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":325,"threads_started":1}
W20260806 10:42:05.438634 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:05.429555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:35263 (local address 127.16.45.126:36645)
0806 10:42:05.429741 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:05.429748 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:05.430157 (+ 409us) server_negotiation.cc:407] Connection header received
0806 10:42:05.430354 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:05.430359 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:05.430460 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:05.430539 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:05.431271 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:05.431994 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:05.433219 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:05.433628 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:05.433716 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:05.438357 (+ 4641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:35263: BlockingRecv error: recv got EOF from 127.16.45.67:35263 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 06 10:42:05 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:05 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:05.504166 30704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:05.495162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:46879)
0806 10:42:05.495673 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:05.495691 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:05.495811 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:05.496087 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:05.496091 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:05.496556 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:05.496710 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:05.496719 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:05.497699 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:05.497705 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:05.498706 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:05.498720 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:05.499369 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:05.499373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:05.499520 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:05.500101 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:05.500119 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:05.503841 (+ 3722us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":282,"threads_started":1}
W20260806 10:42:05.504311 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:05.495289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:46879 (local address 127.16.45.126:36645)
0806 10:42:05.495455 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:05.495460 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:05.495759 (+ 299us) server_negotiation.cc:407] Connection header received
0806 10:42:05.495919 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:05.495922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:05.495985 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:05.496056 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:05.496831 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:05.497556 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:05.498847 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:05.499237 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:05.499330 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:05.504096 (+ 4766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:46879: BlockingRecv error: recv got EOF from 127.16.45.65:46879 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 10:42:06 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:06 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:06.006942 30705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:05.997812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:44571)
0806 10:42:05.998304 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:05.998342 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:05.998483 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:05.998824 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:05.998827 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:05.999239 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:05.999395 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:05.999404 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:06.000476 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:06.000482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:06.001413 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:06.001425 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:06.002287 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:06.002293 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:06.002511 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:06.003158 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:06.003182 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:06.006703 (+ 3521us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":258,"threads_started":1}
W20260806 10:42:06.007143 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:05.998049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:44571 (local address 127.16.45.126:36645)
0806 10:42:05.998308 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:05.998333 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:05.998458 (+ 125us) server_negotiation.cc:407] Connection header received
0806 10:42:05.998632 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:05.998636 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:05.998703 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:05.998789 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:05.999547 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:06.000356 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:06.001562 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:06.002144 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:06.002256 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:06.006898 (+ 4642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:44571: BlockingRecv error: recv got EOF from 127.16.45.66:44571 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 06 10:42:06 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:06 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:06.448698 30706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:06.439523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:58329)
0806 10:42:06.440056 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:06.440074 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:06.440210 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:06.440511 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:06.440514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:06.440950 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:06.441106 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:06.441115 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:06.442142 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:06.442147 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:06.443309 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:06.443324 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:06.444186 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:06.444193 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:06.444399 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:06.445002 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:06.445020 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:06.448455 (+ 3435us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":286,"threads_started":1}
W20260806 10:42:06.448966 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:06.439683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:58329 (local address 127.16.45.126:36645)
0806 10:42:06.439860 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:06.439872 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:06.440147 (+ 275us) server_negotiation.cc:407] Connection header received
0806 10:42:06.440325 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:06.440329 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:06.440396 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:06.440478 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:06.441243 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:06.441993 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:06.443460 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:06.444003 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:06.444148 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:06.448691 (+ 4543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:58329: BlockingRecv error: recv got EOF from 127.16.45.67:58329 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 10:42:06 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:06 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:06.514268 30707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:06.505163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:34133)
0806 10:42:06.505863 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:06.505879 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:06.506022 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:06.506378 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:06.506383 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:06.506802 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:06.506982 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:06.506990 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:06.508087 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:06.508091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:06.509041 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:06.509052 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:06.509942 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:06.509946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:06.510100 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:06.510655 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:06.510674 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:06.514025 (+ 3351us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":402,"threads_started":1}
W20260806 10:42:06.514566 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:06.505248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:34133 (local address 127.16.45.126:36645)
0806 10:42:06.505451 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:06.505455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:06.505970 (+ 515us) server_negotiation.cc:407] Connection header received
0806 10:42:06.506155 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:06.506159 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:06.506223 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:06.506301 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:06.507105 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:06.507948 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:06.509211 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:06.509772 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:06.509883 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:06.514277 (+ 4394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:34133: BlockingRecv error: recv got EOF from 127.16.45.65:34133 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 06 10:42:07 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:07 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:07.017127 30708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:07.007852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:50527)
0806 10:42:07.008383 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:07.008399 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:07.008539 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:07.008875 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:07.008880 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:07.009355 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:07.009552 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:07.009562 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:07.010710 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:07.010714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:07.011648 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:07.011660 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:07.012374 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:07.012380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:07.012552 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:07.013165 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:07.013185 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:07.016856 (+ 3671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":278,"threads_started":1}
W20260806 10:42:07.017344 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:07.008002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:50527 (local address 127.16.45.126:36645)
0806 10:42:07.008281 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:07.008288 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:07.008483 (+ 195us) server_negotiation.cc:407] Connection header received
0806 10:42:07.008653 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:07.008658 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:07.008721 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:07.008822 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:07.009699 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:07.010575 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:07.011795 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:07.012219 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:07.012333 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:07.017107 (+ 4774us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:50527: BlockingRecv error: recv got EOF from 127.16.45.66:50527 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 06 10:42:07 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:07 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:07.459395 30709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:07.449625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:35353)
0806 10:42:07.450342 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:07.450365 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:07.450511 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:07.450885 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:07.450891 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:07.451345 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:07.451535 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:07.451546 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:07.452693 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:07.452704 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:07.453689 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:07.453703 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:07.454537 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:07.454544 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:07.454752 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:07.455331 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:07.455351 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:07.459076 (+ 3725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":451,"threads_started":1}
W20260806 10:42:07.459539 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:07.449728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:35353 (local address 127.16.45.126:36645)
0806 10:42:07.449945 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:07.449954 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:07.450441 (+ 487us) server_negotiation.cc:407] Connection header received
0806 10:42:07.450649 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:07.450653 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:07.450720 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:07.450810 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:07.451694 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:07.452531 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:07.453846 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:07.454372 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:07.454498 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:07.459308 (+ 4810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:35353: BlockingRecv error: recv got EOF from 127.16.45.67:35353 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 06 10:42:07 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:07 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:07.524201 30710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:07.515271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:44877)
0806 10:42:07.515850 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:07.515866 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:07.516003 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:07.516314 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:07.516319 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:07.516773 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:07.516945 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:07.516954 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:07.518095 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:07.518099 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:07.519090 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:07.519103 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:07.519787 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:07.519793 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:07.519953 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:07.520524 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:07.520541 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:07.523949 (+ 3408us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":279,"threads_started":1}
W20260806 10:42:07.524397 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:07.515375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:44877 (local address 127.16.45.126:36645)
0806 10:42:07.515560 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:07.515566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:07.515955 (+ 389us) server_negotiation.cc:407] Connection header received
0806 10:42:07.516123 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:07.516128 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:07.516190 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:07.516272 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:07.517093 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:07.517948 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:07.519226 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:07.519644 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:07.519753 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:07.524177 (+ 4424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:44877: BlockingRecv error: recv got EOF from 127.16.45.65:44877 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 06 10:42:08 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:08 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:08.028242 30711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:08.018205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:46799)
0806 10:42:08.018832 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:08.018848 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:08.018977 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:08.019405 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:08.019410 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:08.019880 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:08.020058 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:08.020068 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:08.021182 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:08.021187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:08.022496 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:08.022510 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:08.023451 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:08.023456 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:08.023573 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:08.024156 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:08.024177 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:08.028004 (+ 3827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":281,"threads_started":1}
W20260806 10:42:08.028472 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:08.018344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:46799 (local address 127.16.45.126:36645)
0806 10:42:08.018622 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:08.018631 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:08.018934 (+ 303us) server_negotiation.cc:407] Connection header received
0806 10:42:08.019136 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:08.019141 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:08.019208 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:08.019308 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:08.020244 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:08.021032 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:08.022653 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:08.023303 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:08.023390 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:08.028222 (+ 4832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:46799: BlockingRecv error: recv got EOF from 127.16.45.66:46799 (error 108)
Metrics: {"server-negotiator.queue_time_us":125}
Aug 06 10:42:08 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:08 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:08.470201 30712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:08.460587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:33571)
0806 10:42:08.461172 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:08.461188 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:08.461355 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:08.461748 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:08.461752 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:08.462185 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:08.462440 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:08.462451 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:08.463644 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:08.463650 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:08.464889 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:08.464901 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:08.465627 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:08.465631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:08.465752 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:08.466388 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:08.466411 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:08.469946 (+ 3535us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":280,"threads_started":1}
W20260806 10:42:08.470419 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:08.460680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:33571 (local address 127.16.45.126:36645)
0806 10:42:08.460891 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:08.460899 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:08.461326 (+ 427us) server_negotiation.cc:407] Connection header received
0806 10:42:08.461502 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:08.461506 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:08.461574 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:08.461690 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:08.462589 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:08.463499 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:08.465044 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:08.465479 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:08.465580 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:08.470158 (+ 4578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:33571: BlockingRecv error: recv got EOF from 127.16.45.67:33571 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 06 10:42:08 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:08 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:08.534178 30713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:08.525158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:50353)
0806 10:42:08.525751 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:08.525769 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:08.525917 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:08.526235 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:08.526239 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:08.526678 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:08.526852 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:08.526861 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:08.527910 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:08.527914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:08.528856 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:08.528875 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:08.529591 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:08.529597 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:08.529743 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:08.530305 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:08.530344 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:08.533826 (+ 3482us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":306,"threads_started":1}
W20260806 10:42:08.534399 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:08.525390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:50353 (local address 127.16.45.126:36645)
0806 10:42:08.525626 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:08.525632 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:08.525851 (+ 219us) server_negotiation.cc:407] Connection header received
0806 10:42:08.526042 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:08.526046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:08.526109 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:08.526188 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:08.527007 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:08.527760 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:08.529000 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:08.529417 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:08.529526 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:08.534102 (+ 4576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:50353: BlockingRecv error: recv got EOF from 127.16.45.65:50353 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 06 10:42:09 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:09 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:09.038404 30714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:09.029175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:54723)
0806 10:42:09.029708 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:09.029725 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:09.029847 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:09.030155 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:09.030159 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:09.030629 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:09.030816 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:09.030827 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:09.031999 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:09.032003 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:09.032988 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:09.033002 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:09.033758 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:09.033764 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:09.033895 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:09.034599 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:09.034618 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:09.038077 (+ 3459us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":275,"threads_started":1}
W20260806 10:42:09.038611 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:09.029270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:54723 (local address 127.16.45.126:36645)
0806 10:42:09.029441 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:09.029446 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:09.029795 (+ 349us) server_negotiation.cc:407] Connection header received
0806 10:42:09.029934 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:09.029937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:09.030020 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:09.030101 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:09.030952 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:09.031846 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:09.033132 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:09.033573 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:09.033662 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:09.038386 (+ 4724us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:54723: BlockingRecv error: recv got EOF from 127.16.45.66:54723 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 10:42:09 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:09 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:09.483714 30715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:09.471173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:34745)
0806 10:42:09.471671 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:09.471687 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:09.471835 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:09.472197 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:09.472202 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:09.472608 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:09.472788 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:09.472797 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:09.473857 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:09.473861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:09.474866 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:09.474879 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:09.475635 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:09.475641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:09.475789 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:09.479664 (+ 3875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:09.479691 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:09.483431 (+ 3740us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":251,"threads_started":1}
W20260806 10:42:09.483949 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:09.471218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:34745 (local address 127.16.45.126:36645)
0806 10:42:09.471440 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:09.471447 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:09.471770 (+ 323us) server_negotiation.cc:407] Connection header received
0806 10:42:09.471952 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:09.471958 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:09.472026 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:09.472111 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:09.472934 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:09.473689 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:09.475004 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:09.475457 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:09.475567 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:09.483695 (+ 8128us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:34745: BlockingRecv error: recv got EOF from 127.16.45.67:34745 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 10:42:09 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:09 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:09.544471 30716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:09.535166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:57711)
0806 10:42:09.535702 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:09.535718 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:09.535848 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:09.536180 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:09.536184 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:09.536624 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:09.536780 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:09.536790 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:09.537808 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:09.537813 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:09.538908 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:09.538924 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:09.539658 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:09.539663 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:09.539849 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:09.540550 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:09.540574 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:09.544238 (+ 3664us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":320,"threads_started":1}
W20260806 10:42:09.544718 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:09.535249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:57711 (local address 127.16.45.126:36645)
0806 10:42:09.535469 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:09.535475 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:09.535805 (+ 330us) server_negotiation.cc:407] Connection header received
0806 10:42:09.535976 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:09.535980 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:09.536045 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:09.536128 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:09.536944 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:09.537670 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:09.539052 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:09.539508 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:09.539619 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:09.544486 (+ 4867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:57711: BlockingRecv error: recv got EOF from 127.16.45.65:57711 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 06 10:42:10 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:10 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:10.049101 30717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:10.039483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:34507)
0806 10:42:10.040046 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:10.040066 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:10.040208 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:10.040530 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:10.040535 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:10.040984 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:10.041146 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:10.041155 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:10.042308 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:10.042347 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:10.043309 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:10.043330 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:10.044069 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:10.044075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:10.044249 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:10.044920 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:10.044945 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:10.048780 (+ 3835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":276,"threads_started":1}
W20260806 10:42:10.049301 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:10.039615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:34507 (local address 127.16.45.126:36645)
0806 10:42:10.039851 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:10.039857 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:10.040148 (+ 291us) server_negotiation.cc:407] Connection header received
0806 10:42:10.040319 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:10.040325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:10.040390 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:10.040470 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:10.041374 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:10.042149 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:10.043473 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:10.043906 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:10.044025 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:10.049026 (+ 5001us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:34507: BlockingRecv error: recv got EOF from 127.16.45.66:34507 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 06 10:42:10 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:10 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:10.493638 30718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:10.484637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:38879)
0806 10:42:10.485142 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:10.485164 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:10.485293 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:10.485705 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:10.485709 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:10.486131 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:10.486279 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:10.486287 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:10.487272 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:10.487275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:10.488231 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:10.488243 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:10.488880 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:10.488884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:10.489001 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:10.489523 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:10.489539 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:10.493392 (+ 3853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":249,"threads_started":1}
W20260806 10:42:10.493714 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:10.484782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:38879 (local address 127.16.45.126:36645)
0806 10:42:10.485018 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:10.485025 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:10.485244 (+ 219us) server_negotiation.cc:407] Connection header received
0806 10:42:10.485501 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:10.485506 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:10.485568 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:10.485649 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:10.486455 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:10.487170 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:10.488349 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:10.488774 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:10.488861 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:10.493537 (+ 4676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:38879: BlockingRecv error: recv got EOF from 127.16.45.67:38879 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 06 10:42:10 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:10 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:10.554383 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:10.545396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:48455)
0806 10:42:10.545929 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:10.545944 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:10.546083 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:10.546462 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:10.546467 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:10.546872 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:10.547034 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:10.547043 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:10.548051 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:10.548056 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:10.549041 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:10.549053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:10.549957 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:10.549962 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:10.550094 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:10.550678 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:10.550695 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:10.554087 (+ 3392us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":297,"threads_started":1}
W20260806 10:42:10.554569 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:10.545521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:48455 (local address 127.16.45.126:36645)
0806 10:42:10.545772 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:10.545778 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:10.546026 (+ 248us) server_negotiation.cc:407] Connection header received
0806 10:42:10.546204 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:10.546209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:10.546290 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:10.546401 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:10.547176 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:10.547916 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:10.549176 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:10.549784 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:10.549915 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:10.554285 (+ 4370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:48455: BlockingRecv error: recv got EOF from 127.16.45.65:48455 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 06 10:42:11 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:11 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:11.059128 30720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:11.050038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:45197)
0806 10:42:11.050570 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:11.050586 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:11.050719 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:11.051089 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:11.051093 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:11.051509 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:11.051672 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:11.051681 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:11.052684 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:11.052687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:11.053664 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:11.053676 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:11.054392 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:11.054397 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:11.054552 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:11.055135 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:11.055154 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:11.058849 (+ 3695us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":311,"threads_started":1}
W20260806 10:42:11.059271 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:11.050093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:45197 (local address 127.16.45.126:36645)
0806 10:42:11.050306 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:11.050334 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:11.050669 (+ 335us) server_negotiation.cc:407] Connection header received
0806 10:42:11.050860 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:11.050864 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:11.050928 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:11.051007 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:11.051816 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:11.052540 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:11.053801 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:11.054204 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:11.054344 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:11.059057 (+ 4713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:45197: BlockingRecv error: recv got EOF from 127.16.45.66:45197 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 06 10:42:11 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:11 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:11.503005 30721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:11.494581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:55693)
0806 10:42:11.495055 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:11.495071 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:11.495184 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:11.495447 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:11.495450 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:11.495836 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:11.496022 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:11.496031 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:11.497035 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:11.497039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:11.498035 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:11.498048 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:11.498747 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:11.498757 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:11.498885 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:11.499435 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:11.499452 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:11.502759 (+ 3307us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":256,"threads_started":1}
W20260806 10:42:11.503196 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:11.494733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:55693 (local address 127.16.45.126:36645)
0806 10:42:11.494981 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:11.494988 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:11.495140 (+ 152us) server_negotiation.cc:407] Connection header received
0806 10:42:11.495273 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:11.495277 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:11.495339 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:11.495416 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:11.496141 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:11.496910 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:11.498155 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:11.498632 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:11.498728 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:11.502956 (+ 4228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:55693: BlockingRecv error: recv got EOF from 127.16.45.67:55693 (error 108)
Metrics: {"server-negotiator.queue_time_us":118}
Aug 06 10:42:11 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:11 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:11.563896 30724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:11.555265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:57145)
0806 10:42:11.555752 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:11.555767 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:11.555903 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:11.556219 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:11.556224 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:11.556681 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:11.556867 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:11.556878 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:11.557853 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:11.557859 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:11.558813 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:11.558826 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:11.559557 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:11.559562 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:11.559694 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:11.560240 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:11.560256 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:11.563656 (+ 3400us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":269,"threads_started":1}
W20260806 10:42:11.564126 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:11.555357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:57145 (local address 127.16.45.126:36645)
0806 10:42:11.555601 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:11.555606 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:11.555853 (+ 247us) server_negotiation.cc:407] Connection header received
0806 10:42:11.556025 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:11.556030 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:11.556093 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:11.556172 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:11.557013 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:11.557728 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:11.558954 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:11.559409 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:11.559531 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:11.563881 (+ 4350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:57145: BlockingRecv error: recv got EOF from 127.16.45.65:57145 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 06 10:42:12 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:12 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:12.069343 30725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:12.060106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:37177)
0806 10:42:12.060744 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:12.060761 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:12.060910 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:12.061238 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:12.061243 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:12.061717 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:12.061929 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:12.061939 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:12.063109 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:12.063113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:12.064124 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:12.064137 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:12.064819 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:12.064826 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:12.064991 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:12.065592 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:12.065610 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:12.069107 (+ 3497us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":403,"threads_started":1}
W20260806 10:42:12.069542 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:12.060339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:37177 (local address 127.16.45.126:36645)
0806 10:42:12.060587 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:12.060593 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:12.060854 (+ 261us) server_negotiation.cc:407] Connection header received
0806 10:42:12.061035 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:12.061039 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:12.061104 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:12.061186 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:12.062078 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:12.062978 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:12.064257 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:12.064669 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:12.064782 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:12.069321 (+ 4539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:37177: BlockingRecv error: recv got EOF from 127.16.45.66:37177 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 06 10:42:12 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:12 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:12.512575 30727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:12.503961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:55497)
0806 10:42:12.504463 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:12.504481 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:12.504601 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:12.504887 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:12.504890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:12.505304 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:12.505507 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:12.505515 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:12.506544 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:12.506548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:12.507554 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:12.507568 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:12.508242 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:12.508247 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:12.508380 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:12.508955 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:12.508972 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:12.512347 (+ 3375us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":272,"threads_started":1}
W20260806 10:42:12.512712 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:12.504071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:55497 (local address 127.16.45.126:36645)
0806 10:42:12.504235 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:12.504240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:12.504551 (+ 311us) server_negotiation.cc:407] Connection header received
0806 10:42:12.504692 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:12.504696 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:12.504760 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:12.504862 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:12.505635 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:12.506420 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:12.507688 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:12.508101 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:12.508190 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:12.512520 (+ 4330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:55497: BlockingRecv error: recv got EOF from 127.16.45.67:55497 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 06 10:42:12 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:12 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:12.574766 30728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:12.565001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:39443)
0806 10:42:12.565590 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:12.565606 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:12.565728 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:12.566107 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:12.566110 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:12.566596 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:12.566769 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:12.566778 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:12.567895 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:12.567900 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:12.568839 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:12.568852 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:12.569852 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:12.569859 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:12.570021 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:12.570687 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:12.570709 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:12.574518 (+ 3809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":301,"threads_started":1}
W20260806 10:42:12.575047 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:12.565101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:39443 (local address 127.16.45.126:36645)
0806 10:42:12.565286 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:12.565290 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:12.565686 (+ 396us) server_negotiation.cc:407] Connection header received
0806 10:42:12.565913 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:12.565917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:12.565987 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:12.566079 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:12.566926 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:12.567749 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:12.569000 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:12.569650 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:12.569774 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:12.574768 (+ 4994us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:39443: BlockingRecv error: recv got EOF from 127.16.45.65:39443 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 06 10:42:13 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:13 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:13.079985 30729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:13.070529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:46755)
0806 10:42:13.071131 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:13.071149 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:13.071309 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:13.071698 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:13.071703 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:13.072153 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:13.072341 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:13.072352 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:13.073503 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:13.073507 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:13.074568 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:13.074582 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:13.075397 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:13.075402 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:13.075546 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:13.076135 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:13.076154 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:13.079615 (+ 3461us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":328,"threads_started":1}
W20260806 10:42:13.080085 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:13.070596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:46755 (local address 127.16.45.126:36645)
0806 10:42:13.070798 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:13.070806 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:13.071250 (+ 444us) server_negotiation.cc:407] Connection header received
0806 10:42:13.071477 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:13.071482 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:13.071551 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:13.071640 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:13.072496 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:13.073361 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:13.074699 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:13.075176 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:13.075297 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:13.079831 (+ 4534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:46755: BlockingRecv error: recv got EOF from 127.16.45.66:46755 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 06 10:42:13 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:13 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:13.522957 30730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:13.513658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:38673)
0806 10:42:13.514347 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:13.514367 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:13.514511 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:13.514874 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:13.514878 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:13.515391 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:13.515614 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:13.515624 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:13.516777 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:13.516782 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:13.517716 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:13.517728 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:13.518470 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:13.518476 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:13.518655 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:13.519277 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:13.519297 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:13.522590 (+ 3293us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":369,"threads_started":1}
W20260806 10:42:13.523073 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:13.513758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:38673 (local address 127.16.45.126:36645)
0806 10:42:13.514030 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:13.514038 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:13.514458 (+ 420us) server_negotiation.cc:407] Connection header received
0806 10:42:13.514641 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:13.514646 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:13.514712 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:13.514796 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:13.515757 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:13.516643 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:13.517857 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:13.518281 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:13.518424 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:13.522819 (+ 4395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:38673: BlockingRecv error: recv got EOF from 127.16.45.67:38673 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
Aug 06 10:42:13 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:13 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:13.584582 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:13.575834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:34063)
0806 10:42:13.576317 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:13.576335 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:13.576454 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:13.576804 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:13.576807 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:13.577330 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:13.577496 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:13.577505 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:13.578501 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:13.578505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:13.579431 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:13.579442 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:13.580101 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:13.580105 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:13.580221 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:13.580805 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:13.580829 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:13.584273 (+ 3444us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":254,"threads_started":1}
W20260806 10:42:13.584728 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:13.575891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:34063 (local address 127.16.45.126:36645)
0806 10:42:13.576080 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:13.576086 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:13.576426 (+ 340us) server_negotiation.cc:407] Connection header received
0806 10:42:13.576572 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:13.576576 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:13.576655 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:13.576769 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:13.577621 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:13.578379 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:13.579558 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:13.579994 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:13.580085 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:13.584503 (+ 4418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:34063: BlockingRecv error: recv got EOF from 127.16.45.65:34063 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 06 10:42:14 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:14 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:14.089910 30735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:14.080982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:51409)
0806 10:42:14.081477 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:14.081496 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:14.081635 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:14.082043 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:14.082047 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:14.082534 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:14.082696 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:14.082705 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:14.083808 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:14.083813 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:14.084754 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:14.084767 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:14.085479 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:14.085484 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:14.085614 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:14.086173 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:14.086190 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:14.089655 (+ 3465us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":444,"threads_started":1}
W20260806 10:42:14.090085 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:14.081214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:51409 (local address 127.16.45.126:36645)
0806 10:42:14.081421 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:14.081428 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:14.081577 (+ 149us) server_negotiation.cc:407] Connection header received
0806 10:42:14.081783 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:14.081787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:14.081856 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:14.082009 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:14.082841 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:14.083660 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:14.084883 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:14.085332 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:14.085422 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:14.089866 (+ 4444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:51409: BlockingRecv error: recv got EOF from 127.16.45.66:51409 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 06 10:42:14 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:14 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.67@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:14.535640 30736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:14.524108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.67:42097)
0806 10:42:14.524556 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:14.524572 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:14.524693 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:14.524962 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:14.524965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:14.525376 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:14.525543 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:14.525552 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:14.526802 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:14.526807 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:14.527747 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:14.527760 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:14.528485 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:14.528489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:14.528620 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:14.531833 (+ 3213us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:14.531853 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:14.535397 (+ 3544us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":241,"threads_started":1}
W20260806 10:42:14.535869 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:14.524176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:42097 (local address 127.16.45.126:36645)
0806 10:42:14.524439 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:14.524446 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:14.524647 (+ 201us) server_negotiation.cc:407] Connection header received
0806 10:42:14.524779 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:14.524783 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:14.524852 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:14.524933 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:14.525690 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:14.526632 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:14.527912 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:14.528343 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:14.528470 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:14.535619 (+ 7149us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.67:42097: BlockingRecv error: recv got EOF from 127.16.45.67:42097 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 10:42:14 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:14 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.65@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:14.595065 30738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:14.585939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.65:48487)
0806 10:42:14.586544 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:14.586562 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:14.586698 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:14.587042 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:14.587046 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:14.587459 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:14.587651 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:14.587660 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:14.588629 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:14.588633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:14.589661 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:14.589674 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:14.590551 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:14.590555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:14.590689 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:14.591272 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:14.591291 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:14.594822 (+ 3531us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":323,"threads_started":1}
W20260806 10:42:14.595247 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:14.586028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:48487 (local address 127.16.45.126:36645)
0806 10:42:14.586350 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:14.586357 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:14.586638 (+ 281us) server_negotiation.cc:407] Connection header received
0806 10:42:14.586801 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:14.586805 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:14.586888 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:14.586968 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:14.587772 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:14.588491 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:14.589788 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:14.590224 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:14.590370 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:14.595000 (+ 4630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.65:48487: BlockingRecv error: recv got EOF from 127.16.45.65:48487 (error 108)
Metrics: {"server-negotiator.queue_time_us":139}
Aug 06 10:42:15 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 10:42:15 dist-test-slave-fgb3 krb5kdc[29179](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.45.66@KRBTEST.COM for oryx/127.16.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 10:42:15.101305 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:15.091396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36645 (local address 127.16.45.66:54225)
0806 10:42:15.091930 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:15.091948 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:15.092077 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:15.092416 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:15.092420 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:15.092836 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:15.093056 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:15.093068 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:15.094205 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:15.094209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:15.095499 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:15.095516 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:15.096407 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:15.096414 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:15.096599 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:15.097249 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:15.097269 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:15.100929 (+ 3660us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.45.126:36645: Server oryx/127.16.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":253,"threads_started":1}
W20260806 10:42:15.101495 30678 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:15.091538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:54225 (local address 127.16.45.126:36645)
0806 10:42:15.091728 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:15.091732 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:15.092030 (+ 298us) server_negotiation.cc:407] Connection header received
0806 10:42:15.092174 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:15.092178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:15.092244 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:15.092341 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:15.093250 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:15.094032 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:15.095643 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:15.096248 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:15.096378 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:15.101204 (+ 4826us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.45.66:54225: BlockingRecv error: recv got EOF from 127.16.45.66:54225 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 10:42:15.301991 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 30060
I20260806 10:42:15.316867 30741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:15.303440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46290 (local address 127.16.45.65:41635)
0806 10:42:15.304139 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:15.304146 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:15.304175 (+ 29us) server_negotiation.cc:407] Connection header received
0806 10:42:15.304247 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:15.304254 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:15.304488 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:15.304659 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:15.306214 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:15.307418 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:15.308700 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:15.309279 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:15.309387 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:15.312162 (+ 2775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:15.312175 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:15.312196 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:42:15.312279 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:15.316154 (+ 3875us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.16.45.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 10:42:15.316563 (+ 409us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46290: Request ticket server kudu/127.16.45.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":363,"threads_started":1}
W20260806 10:42:15.316985 30741 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46290: Request ticket server kudu/127.16.45.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 10:42:15.317467 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 30060: Not authorized: Client connection negotiation failed: client connection to 127.16.45.65:41635: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.16.45.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 10:42:15.317723 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 30060
I20260806 10:42:15.341169 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 30290
I20260806 10:42:15.354620 30742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:15.342307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46086 (local address 127.16.45.66:40845)
0806 10:42:15.342984 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:15.342991 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:15.343024 (+ 33us) server_negotiation.cc:407] Connection header received
0806 10:42:15.343090 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:15.343097 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:15.343344 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:15.343520 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:15.345303 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:15.346565 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:15.347812 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:15.348428 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:15.348538 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:15.351184 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:15.351194 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:15.351210 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:42:15.351254 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:15.353993 (+ 2739us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.16.45.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 10:42:15.354284 (+ 291us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46086: Request ticket server kudu/127.16.45.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":266,"threads_started":1}
W20260806 10:42:15.354727 30742 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46086: Request ticket server kudu/127.16.45.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 10:42:15.354776 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 30290: Not authorized: Client connection negotiation failed: client connection to 127.16.45.66:40845: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.16.45.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 10:42:15.354944 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 30290
I20260806 10:42:15.375670 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 30489
I20260806 10:42:15.389343 30744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:15.376860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51782 (local address 127.16.45.67:40795)
0806 10:42:15.377511 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:15.377519 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:15.377547 (+ 28us) server_negotiation.cc:407] Connection header received
0806 10:42:15.377616 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:15.377623 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:15.377873 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:15.378068 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:15.380040 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:15.381177 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:15.382591 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:15.383267 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:15.383386 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:15.385961 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:15.385970 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:15.385991 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:42:15.386045 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:15.388758 (+ 2713us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.16.45.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 10:42:15.389091 (+ 333us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51782: Request ticket server kudu/127.16.45.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":328,"threads_started":1}
W20260806 10:42:15.389448 30744 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51782: Request ticket server kudu/127.16.45.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 10:42:15.389513 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 30489: Not authorized: Client connection negotiation failed: client connection to 127.16.45.67:40795: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.16.45.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 10:42:15.389691 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 30489
I20260806 10:42:15.409236 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 29950
I20260806 10:42:15.411010 30049 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:15.530093 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 29950
2026-08-06T10:42:15Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21458 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T10:42:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:42:15Z Disabled control of system clock
I20260806 10:42:15.619570 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:38253
--webserver_interface=127.16.45.126
--webserver_port=0
--builtin_ntp_servers=127.16.45.84:34773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:38253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 10:42:15.956461 30751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:15.956748 30751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:15.956830 30751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:15.963981 30751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:42:15.964098 30751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:15.964136 30751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:15.964191 30751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:42:15.964241 30751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:42:15.973397 30751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:38253
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:38253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:15.974710 30751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:15.976496 30751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:15.987993 30759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:15.988041 30758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:15.988039 30761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:15.988679 30751 server_base.cc:1034] running on GCE node
I20260806 10:42:15.989468 30751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:15.990901 30751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:15.992110 30751 hybrid_clock.cc:648] HybridClock initialized: now 1786012935992058 us; error 43 us; skew 500 ppm
I20260806 10:42:15.992472 30751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:42:15.994831 30751 webserver.cc:460] Webserver started at http://127.16.45.126:45249/ using document root <none> and password file <none>
I20260806 10:42:15.995548 30751 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:15.995654 30751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:15.995968 30751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:42:15.998989 30751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "3969d0e2cffd4fc1b34d913075a6de43"
format_stamp: "Formatted at 2026-08-06 10:42:15 on dist-test-slave-fgb3"
server_key: "42f2f2fdb492c89cf95c83ebcf66d0c8"
server_key_iv: "60c9dc95cc6fab125b221c007324a5e3"
server_key_version: "encryptionkey@0"
I20260806 10:42:15.999780 30751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "3969d0e2cffd4fc1b34d913075a6de43"
format_stamp: "Formatted at 2026-08-06 10:42:15 on dist-test-slave-fgb3"
server_key: "42f2f2fdb492c89cf95c83ebcf66d0c8"
server_key_iv: "60c9dc95cc6fab125b221c007324a5e3"
server_key_version: "encryptionkey@0"
I20260806 10:42:16.004978 30751 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:42:16.008555 30771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:16.009915 30751 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:42:16.010089 30751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "3969d0e2cffd4fc1b34d913075a6de43"
format_stamp: "Formatted at 2026-08-06 10:42:15 on dist-test-slave-fgb3"
server_key: "42f2f2fdb492c89cf95c83ebcf66d0c8"
server_key_iv: "60c9dc95cc6fab125b221c007324a5e3"
server_key_version: "encryptionkey@0"
I20260806 10:42:16.010331 30751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:16.029857 30751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:16.030862 30751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:16.031153 30751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:16.049347 30751 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:38253
I20260806 10:42:16.049355 30846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:38253 every 8 connection(s)
I20260806 10:42:16.050776 30751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:42:16.054541 30847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:42:16.058297 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 30751
I20260806 10:42:16.058545 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:42:16.059372 16565 external_mini_cluster.cc:1428] Setting key 68d8d8d79eb8e2b6d376a9c1e54cfae2
I20260806 10:42:16.068365 30847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43: Bootstrap starting.
I20260806 10:42:16.072247 30847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43: Neither blocks nor log segments found. Creating new log.
I20260806 10:42:16.073422 30847 log.cc:824] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43: Log is configured to *not* fsync() on all Append() calls
I20260806 10:42:16.073760 30852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:16.061523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57340 (local address 127.16.45.126:38253)
0806 10:42:16.062556 (+ 1033us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:16.062566 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:16.062608 (+ 42us) server_negotiation.cc:407] Connection header received
0806 10:42:16.064207 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:16.064232 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:16.064753 (+ 521us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:16.065117 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:16.065887 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:16.067281 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:16.069165 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:16.069929 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:16.070080 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:16.071398 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:16.071406 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:16.071423 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:16.071960 (+ 537us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:16.072055 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:16.072077 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:16.072169 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:16.072428 (+ 259us) server_negotiation.cc:299] Negotiation successful
0806 10:42:16.072783 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":382,"threads_started":1}
I20260806 10:42:16.077589 30847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43: No bootstrap required, opened a new log
I20260806 10:42:16.085055 30847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3969d0e2cffd4fc1b34d913075a6de43" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 38253 } }
I20260806 10:42:16.085446 30847 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:42:16.085554 30847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3969d0e2cffd4fc1b34d913075a6de43, State: Initialized, Role: FOLLOWER
I20260806 10:42:16.086113 30847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3969d0e2cffd4fc1b34d913075a6de43" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 38253 } }
I20260806 10:42:16.086337 30847 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:42:16.086468 30847 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:42:16.086635 30847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:42:16.089008 30847 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3969d0e2cffd4fc1b34d913075a6de43" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 38253 } }
I20260806 10:42:16.089510 30847 leader_election.cc:302] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3969d0e2cffd4fc1b34d913075a6de43; no voters:
I20260806 10:42:16.090077 30847 leader_election.cc:288] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:42:16.090214 30854 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:42:16.090902 30854 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [term 1 LEADER]: Becoming Leader. State: Replica: 3969d0e2cffd4fc1b34d913075a6de43, State: Running, Role: LEADER
I20260806 10:42:16.091434 30854 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3969d0e2cffd4fc1b34d913075a6de43" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 38253 } }
I20260806 10:42:16.092161 30847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:42:16.094137 30857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3969d0e2cffd4fc1b34d913075a6de43. Latest consensus state: current_term: 1 leader_uuid: "3969d0e2cffd4fc1b34d913075a6de43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3969d0e2cffd4fc1b34d913075a6de43" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 38253 } } }
I20260806 10:42:16.094650 30857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [sys.catalog]: This master's current role is: LEADER
I20260806 10:42:16.095280 30855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3969d0e2cffd4fc1b34d913075a6de43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3969d0e2cffd4fc1b34d913075a6de43" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 38253 } } }
I20260806 10:42:16.095613 30855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43 [sys.catalog]: This master's current role is: LEADER
I20260806 10:42:16.096259 30865 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:42:16.101378 30865 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:42:16.110558 30865 catalog_manager.cc:1347] Generated new cluster ID: 369bca34ba8b4e388e8fde949dc5b8cf
I20260806 10:42:16.110683 30865 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:42:16.127629 30865 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:42:16.128870 30865 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:42:16.137080 30865 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3969d0e2cffd4fc1b34d913075a6de43: Generated new TSK 0
I20260806 10:42:16.137912 30865 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:42:16.144934 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:38253
--builtin_ntp_servers=127.16.45.84:34773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 10:42:16.499634 30880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:16.499923 30880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:16.500010 30880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:16.507265 30880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:16.507375 30880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:16.507486 30880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:42:16.516655 30880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:38253
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:16.517903 30880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:16.519738 30880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:16.532522 30885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:16.532447 30891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:16.532451 30889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:16.533340 30880 server_base.cc:1034] running on GCE node
I20260806 10:42:16.533965 30880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:16.534965 30880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:16.536180 30880 hybrid_clock.cc:648] HybridClock initialized: now 1786012936536128 us; error 46 us; skew 500 ppm
I20260806 10:42:16.536509 30880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:42:16.538910 30880 webserver.cc:460] Webserver started at http://127.16.45.65:35347/ using document root <none> and password file <none>
I20260806 10:42:16.539620 30880 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:16.539728 30880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:16.540061 30880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:42:16.543084 30880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "ba0b74a0babb4066bd67873dea0d9c35"
format_stamp: "Formatted at 2026-08-06 10:42:16 on dist-test-slave-fgb3"
server_key: "11449089815c9a30da16ced2739c8d5d"
server_key_iv: "fbc1555138592d6e8ebfe2e547e07e08"
server_key_version: "encryptionkey@0"
I20260806 10:42:16.543876 30880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "ba0b74a0babb4066bd67873dea0d9c35"
format_stamp: "Formatted at 2026-08-06 10:42:16 on dist-test-slave-fgb3"
server_key: "11449089815c9a30da16ced2739c8d5d"
server_key_iv: "fbc1555138592d6e8ebfe2e547e07e08"
server_key_version: "encryptionkey@0"
I20260806 10:42:16.549082 30880 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:42:16.552587 30904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:16.553833 30880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:42:16.554026 30880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "ba0b74a0babb4066bd67873dea0d9c35"
format_stamp: "Formatted at 2026-08-06 10:42:16 on dist-test-slave-fgb3"
server_key: "11449089815c9a30da16ced2739c8d5d"
server_key_iv: "fbc1555138592d6e8ebfe2e547e07e08"
server_key_version: "encryptionkey@0"
I20260806 10:42:16.554230 30880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:16.571600 30880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:16.572439 30880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:16.572724 30880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:16.573625 30880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:42:16.575163 30880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:42:16.575260 30880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:16.575366 30880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:42:16.575441 30880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:16.605410 30880 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:37731
I20260806 10:42:16.605464 31090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:37731 every 8 connection(s)
I20260806 10:42:16.606734 30880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:42:16.617053 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 30880
I20260806 10:42:16.617255 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:42:16.617906 16565 external_mini_cluster.cc:1428] Setting key 3b6ebaa3ab76b01af03ce4f859b6a777
I20260806 10:42:16.619220 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:16.609345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:33455 (local address 127.16.45.126:38253)
0806 10:42:16.609759 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:16.609764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:16.610898 (+ 1134us) server_negotiation.cc:407] Connection header received
0806 10:42:16.612634 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:16.612640 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:16.612729 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:16.612831 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:16.613957 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:16.614790 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:16.616312 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:16.616837 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:16.616971 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:16.618378 (+ 1407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:16.618384 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:16.618388 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:16.618410 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:16.618465 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:16.618482 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:16.618562 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:16.618825 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 10:42:16.618925 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":219,"threads_started":1}
I20260806 10:42:16.620445 31095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:16.609802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:38253 (local address 127.16.45.65:33455)
0806 10:42:16.610739 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:16.610782 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:16.612370 (+ 1588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:16.613065 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:16.613073 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:16.613155 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:16.613788 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:16.613816 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:16.614949 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:16.614954 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:16.616170 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:16.616188 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:16.617064 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:16.617069 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:16.617317 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:16.618045 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:42:16.618048 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:16.618089 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:42:16.618168 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:42:16.618584 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:42:16.618595 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:42:16.618603 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 10:42:16.618788 (+ 185us) client_negotiation.cc:240] Negotiation successful
0806 10:42:16.619158 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":261,"threads_started":1}
I20260806 10:42:16.620991 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:38253
--builtin_ntp_servers=127.16.45.84:34773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 10:42:16.621869 31091 heartbeater.cc:347] Connected to a master server at 127.16.45.126:38253
I20260806 10:42:16.622205 31091 heartbeater.cc:464] Registering TS with master...
I20260806 10:42:16.623215 31091 heartbeater.cc:511] Master 127.16.45.126:38253 requested a full tablet report, sending...
I20260806 10:42:16.625339 30802 ts_manager.cc:194] Registered new tserver with Master: ba0b74a0babb4066bd67873dea0d9c35 (127.16.45.65:37731)
I20260806 10:42:16.626847 30802 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.45.65:33455
W20260806 10:42:16.950026 31097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:16.950364 31097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:16.950474 31097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:16.957710 31097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:16.957813 31097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:16.957916 31097 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:42:16.967080 31097 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:38253
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:16.968413 31097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:16.970157 31097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:16.983016 31103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:16.982981 31106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:16.983064 31104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:16.983860 31097 server_base.cc:1034] running on GCE node
I20260806 10:42:16.984477 31097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:16.985419 31097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:16.986645 31097 hybrid_clock.cc:648] HybridClock initialized: now 1786012936986596 us; error 33 us; skew 500 ppm
I20260806 10:42:16.986969 31097 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:42:16.989257 31097 webserver.cc:460] Webserver started at http://127.16.45.66:37293/ using document root <none> and password file <none>
I20260806 10:42:16.989928 31097 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:16.990017 31097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:16.990302 31097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:42:16.993330 31097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "6b7cf508dad048df8a5a001e84ecc884"
format_stamp: "Formatted at 2026-08-06 10:42:16 on dist-test-slave-fgb3"
server_key: "b2debf018be29ecb760739423b5ce87d"
server_key_iv: "8fee0ad3c94aa42280885f12bb91d2ba"
server_key_version: "encryptionkey@0"
I20260806 10:42:16.994082 31097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "6b7cf508dad048df8a5a001e84ecc884"
format_stamp: "Formatted at 2026-08-06 10:42:16 on dist-test-slave-fgb3"
server_key: "b2debf018be29ecb760739423b5ce87d"
server_key_iv: "8fee0ad3c94aa42280885f12bb91d2ba"
server_key_version: "encryptionkey@0"
I20260806 10:42:16.999459 31097 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260806 10:42:17.002954 31114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:17.004379 31097 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:42:17.004525 31097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "6b7cf508dad048df8a5a001e84ecc884"
format_stamp: "Formatted at 2026-08-06 10:42:16 on dist-test-slave-fgb3"
server_key: "b2debf018be29ecb760739423b5ce87d"
server_key_iv: "8fee0ad3c94aa42280885f12bb91d2ba"
server_key_version: "encryptionkey@0"
I20260806 10:42:17.004714 31097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:17.027278 31097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:17.028131 31097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:17.028401 31097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:17.029469 31097 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:42:17.030978 31097 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:42:17.031068 31097 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:17.031148 31097 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:42:17.031200 31097 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:17.065129 31097 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:36669
I20260806 10:42:17.065192 31278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:36669 every 8 connection(s)
I20260806 10:42:17.066468 31097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:42:17.069866 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 31097
I20260806 10:42:17.070055 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:42:17.070654 16565 external_mini_cluster.cc:1428] Setting key 98f4952ba1c8b4e15c2d13681176c257
I20260806 10:42:17.073398 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:38253
--builtin_ntp_servers=127.16.45.84:34773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 10:42:17.079182 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:17.069078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:42285 (local address 127.16.45.126:38253)
0806 10:42:17.069405 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:17.069410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:17.070950 (+ 1540us) server_negotiation.cc:407] Connection header received
0806 10:42:17.072903 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:17.072909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:17.072992 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:17.073074 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:17.074219 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.074975 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.076497 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.076880 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.076995 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:17.078382 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:17.078387 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:17.078391 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:17.078410 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:17.078449 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:17.078462 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:17.078536 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:17.078748 (+ 212us) server_negotiation.cc:299] Negotiation successful
0806 10:42:17.078854 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 10:42:17.080314 31282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:17.069597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:38253 (local address 127.16.45.66:42285)
0806 10:42:17.070777 (+ 1180us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:17.070823 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:17.072650 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:17.073316 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:17.073325 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:17.073421 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:17.074061 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:17.074080 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.075126 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.075130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:17.076357 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:17.076369 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.077104 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.077112 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:17.077330 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:17.078056 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:42:17.078058 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:17.078099 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:42:17.078183 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:42:17.078549 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:42:17.078559 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:42:17.078567 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 10:42:17.078724 (+ 157us) client_negotiation.cc:240] Negotiation successful
0806 10:42:17.079257 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":453,"threads_started":1}
I20260806 10:42:17.081736 31279 heartbeater.cc:347] Connected to a master server at 127.16.45.126:38253
I20260806 10:42:17.082058 31279 heartbeater.cc:464] Registering TS with master...
I20260806 10:42:17.082901 31279 heartbeater.cc:511] Master 127.16.45.126:38253 requested a full tablet report, sending...
I20260806 10:42:17.084372 30802 ts_manager.cc:194] Registered new tserver with Master: 6b7cf508dad048df8a5a001e84ecc884 (127.16.45.66:36669)
I20260806 10:42:17.085192 30802 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.45.66:42285
W20260806 10:42:17.413426 31283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:17.413695 31283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:17.413785 31283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:17.421056 31283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:17.421160 31283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:17.421296 31283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:42:17.430438 31283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:38253
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:17.431759 31283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:17.433611 31283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:17.446801 31293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:17.446954 31294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:17.446973 31297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:17.452112 31283 server_base.cc:1034] running on GCE node
I20260806 10:42:17.452821 31283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:17.453892 31283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:17.455132 31283 hybrid_clock.cc:648] HybridClock initialized: now 1786012937455086 us; error 42 us; skew 500 ppm
I20260806 10:42:17.455498 31283 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:42:17.457856 31283 webserver.cc:460] Webserver started at http://127.16.45.67:41667/ using document root <none> and password file <none>
I20260806 10:42:17.458667 31283 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:17.458774 31283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:17.459120 31283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:42:17.462061 31283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "02b774800daf470d943b36405e19565a"
format_stamp: "Formatted at 2026-08-06 10:42:17 on dist-test-slave-fgb3"
server_key: "81f73dd17ea13eee105e40eef6073657"
server_key_iv: "ed2294140962fee9c431f120dd132e1a"
server_key_version: "encryptionkey@0"
I20260806 10:42:17.462916 31283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "02b774800daf470d943b36405e19565a"
format_stamp: "Formatted at 2026-08-06 10:42:17 on dist-test-slave-fgb3"
server_key: "81f73dd17ea13eee105e40eef6073657"
server_key_iv: "ed2294140962fee9c431f120dd132e1a"
server_key_version: "encryptionkey@0"
I20260806 10:42:17.468226 31283 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:42:17.472182 31305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:17.473706 31283 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 10:42:17.473883 31283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "02b774800daf470d943b36405e19565a"
format_stamp: "Formatted at 2026-08-06 10:42:17 on dist-test-slave-fgb3"
server_key: "81f73dd17ea13eee105e40eef6073657"
server_key_iv: "ed2294140962fee9c431f120dd132e1a"
server_key_version: "encryptionkey@0"
I20260806 10:42:17.474117 31283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:17.495415 31283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:17.496343 31283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:17.496649 31283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:17.497661 31283 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:42:17.499280 31283 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:42:17.499387 31283 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:17.499501 31283 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:42:17.499571 31283 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:17.531036 31283 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:32987
I20260806 10:42:17.531111 31476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:32987 every 8 connection(s)
I20260806 10:42:17.532325 31283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:42:17.533115 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 31283
I20260806 10:42:17.533279 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:42:17.533800 16565 external_mini_cluster.cc:1428] Setting key abdd17fb548b14c43a746ac4dc2d1c7d
I20260806 10:42:17.544963 31093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:17.534945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:59215 (local address 127.16.45.126:38253)
0806 10:42:17.535120 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:17.535126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:17.536793 (+ 1667us) server_negotiation.cc:407] Connection header received
0806 10:42:17.538656 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:17.538661 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:17.538748 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:17.538835 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:17.539878 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.540617 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.542201 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.542676 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.542788 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:17.544114 (+ 1326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:17.544118 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:17.544122 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:17.544140 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:17.544174 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:17.544186 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:17.544259 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:17.544514 (+ 255us) server_negotiation.cc:299] Negotiation successful
0806 10:42:17.544619 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 10:42:17.545954 31482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:17.535590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:38253 (local address 127.16.45.67:59215)
0806 10:42:17.536648 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:17.536701 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:17.538403 (+ 1702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:17.539068 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:17.539076 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:17.539157 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:17.539725 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:17.539741 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.540760 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.540764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:17.542062 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:17.542075 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.542896 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.542904 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:17.543123 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:17.543779 (+ 656us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:42:17.543782 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:17.543824 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:42:17.543915 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:42:17.544275 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:42:17.544286 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:42:17.544296 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 10:42:17.544479 (+ 183us) client_negotiation.cc:240] Negotiation successful
0806 10:42:17.544896 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":327,"threads_started":1}
I20260806 10:42:17.547509 31477 heartbeater.cc:347] Connected to a master server at 127.16.45.126:38253
I20260806 10:42:17.547823 31477 heartbeater.cc:464] Registering TS with master...
I20260806 10:42:17.548765 31477 heartbeater.cc:511] Master 127.16.45.126:38253 requested a full tablet report, sending...
I20260806 10:42:17.550195 30802 ts_manager.cc:194] Registered new tserver with Master: 02b774800daf470d943b36405e19565a (127.16.45.67:32987)
I20260806 10:42:17.550981 30802 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.45.67:59215
I20260806 10:42:17.562018 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 10:42:17.568141 31093 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:17.566588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57344 (local address 127.16.45.126:38253)
0806 10:42:17.566780 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:17.566785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:17.567324 (+ 539us) server_negotiation.cc:407] Connection header received
0806 10:42:17.567455 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:17.567460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:17.567541 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:17.567621 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:17.567938 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57344: BlockingRecv error: recv got EOF from 127.0.0.1:57344 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 10:42:17.569023 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 30880
I20260806 10:42:17.577006 31491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:17.569903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47210 (local address 127.16.45.65:37731)
0806 10:42:17.570454 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:17.570464 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:17.570500 (+ 36us) server_negotiation.cc:407] Connection header received
0806 10:42:17.570570 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:17.570578 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:17.570807 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:17.570932 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:17.571274 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.572419 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.573881 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.574565 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.574662 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:17.575626 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:17.575634 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:17.575647 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:17.576237 (+ 590us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:17.576283 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:17.576303 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:17.576400 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:17.576511 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 10:42:17.576647 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":254,"threads_started":1}
I20260806 10:42:17.578462 31083 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:17.658743 31091 heartbeater.cc:503] Master 127.16.45.126:38253 was elected leader, sending a full tablet report...
I20260806 10:42:17.660027 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 30880
W20260806 10:42:17.677264 30773 connection.cc:535] server connection from 127.16.45.65:33455 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 10:42:17.677572 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 31097
I20260806 10:42:17.685334 31493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:17.678472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37906 (local address 127.16.45.66:36669)
0806 10:42:17.678987 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:17.678996 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:17.679027 (+ 31us) server_negotiation.cc:407] Connection header received
0806 10:42:17.679100 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:17.679107 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:17.679335 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:17.679456 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:17.679854 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.680863 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.682061 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.682863 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.682969 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:17.683945 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:17.683954 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:17.683967 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:17.684614 (+ 647us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:17.684661 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:17.684681 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:17.684768 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:17.684872 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 10:42:17.684999 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":262,"threads_started":1}
I20260806 10:42:17.686616 31272 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:17.767679 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 31097
I20260806 10:42:17.787386 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 31283
I20260806 10:42:17.795969 31496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:17.788256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48290 (local address 127.16.45.67:32987)
0806 10:42:17.788889 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:17.788897 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:17.788930 (+ 33us) server_negotiation.cc:407] Connection header received
0806 10:42:17.788996 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:17.789002 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:17.789222 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:17.789376 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:17.789904 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.791057 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.792477 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:17.793106 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:17.793197 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:17.794482 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:17.794493 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:17.794508 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:17.795094 (+ 586us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:17.795150 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:17.795171 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:17.795264 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:17.795417 (+ 153us) server_negotiation.cc:299] Negotiation successful
0806 10:42:17.795544 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":299,"threads_started":1}
I20260806 10:42:17.797338 31465 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:17.879382 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 31283
I20260806 10:42:17.900168 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 30751
I20260806 10:42:17.901432 30842 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:18.004562 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 30751
2026-08-06T10:42:18Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2468 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T10:42:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:42:18Z Disabled control of system clock
I20260806 10:42:18.087836 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:42451
--webserver_interface=127.16.45.126
--webserver_port=0
--builtin_ntp_servers=127.16.45.84:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:42451
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 10:42:18.428210 31503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:18.428512 31503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:18.428596 31503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:18.435812 31503 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:42:18.435920 31503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:18.435957 31503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:18.436012 31503 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:42:18.436055 31503 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:42:18.445266 31503 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:42451
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:42451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:18.446580 31503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:18.448266 31503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:18.461323 31516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:18.461298 31513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:18.462062 31511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:18.462728 31503 server_base.cc:1034] running on GCE node
I20260806 10:42:18.463748 31503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:18.465831 31503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:18.467036 31503 hybrid_clock.cc:648] HybridClock initialized: now 1786012938466976 us; error 48 us; skew 500 ppm
I20260806 10:42:18.467418 31503 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:42:18.470088 31503 webserver.cc:460] Webserver started at http://127.16.45.126:34157/ using document root <none> and password file <none>
I20260806 10:42:18.471047 31503 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:18.471215 31503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:18.471598 31503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:42:18.475867 31503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "d9566fceb69b4d5e96e78ebf12d98d66"
format_stamp: "Formatted at 2026-08-06 10:42:18 on dist-test-slave-fgb3"
server_key: "d29e40398a065551c23c3ef337b49049"
server_key_iv: "d382f48180b666d625f80fc2c67b4354"
server_key_version: "encryptionkey@0"
I20260806 10:42:18.476657 31503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "d9566fceb69b4d5e96e78ebf12d98d66"
format_stamp: "Formatted at 2026-08-06 10:42:18 on dist-test-slave-fgb3"
server_key: "d29e40398a065551c23c3ef337b49049"
server_key_iv: "d382f48180b666d625f80fc2c67b4354"
server_key_version: "encryptionkey@0"
I20260806 10:42:18.483174 31503 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260806 10:42:18.488721 31522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:18.490513 31503 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260806 10:42:18.490700 31503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "d9566fceb69b4d5e96e78ebf12d98d66"
format_stamp: "Formatted at 2026-08-06 10:42:18 on dist-test-slave-fgb3"
server_key: "d29e40398a065551c23c3ef337b49049"
server_key_iv: "d382f48180b666d625f80fc2c67b4354"
server_key_version: "encryptionkey@0"
I20260806 10:42:18.491024 31503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:18.498981 31503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:18.500011 31503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:18.500360 31503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:18.519330 31503 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:42451
I20260806 10:42:18.519369 31601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:42451 every 8 connection(s)
I20260806 10:42:18.520630 31503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:42:18.524489 31602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:42:18.527093 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 31503
I20260806 10:42:18.527302 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:42:18.527926 16565 external_mini_cluster.cc:1428] Setting key f8b46a13a02c7f7be81614d91d9eba63
I20260806 10:42:18.536897 31605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:18.529986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42078 (local address 127.16.45.126:42451)
0806 10:42:18.531120 (+ 1134us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:18.531135 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:18.531245 (+ 110us) server_negotiation.cc:407] Connection header received
0806 10:42:18.532975 (+ 1730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:18.533003 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:18.533545 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:18.533972 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:18.535005 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:18.535013 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:18.535032 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:18.535056 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:18.535126 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:18.535151 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:18.535382 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:18.535512 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 10:42:18.535758 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":378,"threads_started":1}
I20260806 10:42:18.537526 31602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66: Bootstrap starting.
I20260806 10:42:18.540472 31602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66: Neither blocks nor log segments found. Creating new log.
I20260806 10:42:18.541407 31602 log.cc:824] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66: Log is configured to *not* fsync() on all Append() calls
I20260806 10:42:18.544065 31602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66: No bootstrap required, opened a new log
I20260806 10:42:18.551060 31602 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9566fceb69b4d5e96e78ebf12d98d66" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42451 } }
I20260806 10:42:18.551399 31602 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:42:18.551491 31602 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9566fceb69b4d5e96e78ebf12d98d66, State: Initialized, Role: FOLLOWER
I20260806 10:42:18.552078 31602 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9566fceb69b4d5e96e78ebf12d98d66" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42451 } }
I20260806 10:42:18.552292 31602 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:42:18.552423 31602 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:42:18.552587 31602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:42:18.554723 31602 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9566fceb69b4d5e96e78ebf12d98d66" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42451 } }
I20260806 10:42:18.555176 31602 leader_election.cc:302] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9566fceb69b4d5e96e78ebf12d98d66; no voters:
I20260806 10:42:18.555724 31602 leader_election.cc:288] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:42:18.555842 31607 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:42:18.556524 31607 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [term 1 LEADER]: Becoming Leader. State: Replica: d9566fceb69b4d5e96e78ebf12d98d66, State: Running, Role: LEADER
I20260806 10:42:18.557017 31607 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9566fceb69b4d5e96e78ebf12d98d66" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42451 } }
I20260806 10:42:18.557698 31602 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:42:18.559648 31608 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9566fceb69b4d5e96e78ebf12d98d66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9566fceb69b4d5e96e78ebf12d98d66" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42451 } } }
I20260806 10:42:18.560045 31608 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [sys.catalog]: This master's current role is: LEADER
I20260806 10:42:18.561190 31609 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9566fceb69b4d5e96e78ebf12d98d66. Latest consensus state: current_term: 1 leader_uuid: "d9566fceb69b4d5e96e78ebf12d98d66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9566fceb69b4d5e96e78ebf12d98d66" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42451 } } }
I20260806 10:42:18.561547 31609 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66 [sys.catalog]: This master's current role is: LEADER
I20260806 10:42:18.562673 31615 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:42:18.566967 31615 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:42:18.574738 31615 catalog_manager.cc:1347] Generated new cluster ID: 4f3d3606cfcb4b0cb1c5bb0ac97913bd
I20260806 10:42:18.574844 31615 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:42:18.600994 31615 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:42:18.601403 31615 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:42:18.606737 31615 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9566fceb69b4d5e96e78ebf12d98d66: Generated new TSK 0
I20260806 10:42:18.607782 31615 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:42:18.613876 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42451
--builtin_ntp_servers=127.16.45.84:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 10:42:18.945393 31634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:18.945655 31634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:18.945753 31634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:18.952909 31634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:18.953008 31634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:18.953114 31634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:42:18.962215 31634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42451
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:18.963696 31634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:18.965510 31634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:18.978245 31648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:18.978282 31644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:18.978386 31643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:18.979051 31634 server_base.cc:1034] running on GCE node
I20260806 10:42:18.979682 31634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:18.980607 31634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:18.981822 31634 hybrid_clock.cc:648] HybridClock initialized: now 1786012938981764 us; error 43 us; skew 500 ppm
I20260806 10:42:18.982115 31634 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:42:18.984450 31634 webserver.cc:460] Webserver started at http://127.16.45.65:34713/ using document root <none> and password file <none>
I20260806 10:42:18.985109 31634 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:18.985203 31634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:18.985496 31634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:42:18.991070 31634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "d8e37e890a3143aa92719fb43de1caad"
format_stamp: "Formatted at 2026-08-06 10:42:18 on dist-test-slave-fgb3"
server_key: "6f72edf3ea7b80c9b65241b453e6fd26"
server_key_iv: "00647742a413ad387bb5bb3dc15ab2de"
server_key_version: "encryptionkey@0"
I20260806 10:42:18.991878 31634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "d8e37e890a3143aa92719fb43de1caad"
format_stamp: "Formatted at 2026-08-06 10:42:18 on dist-test-slave-fgb3"
server_key: "6f72edf3ea7b80c9b65241b453e6fd26"
server_key_iv: "00647742a413ad387bb5bb3dc15ab2de"
server_key_version: "encryptionkey@0"
I20260806 10:42:18.997325 31634 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:42:19.001039 31654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:19.002385 31634 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:42:19.002532 31634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "d8e37e890a3143aa92719fb43de1caad"
format_stamp: "Formatted at 2026-08-06 10:42:18 on dist-test-slave-fgb3"
server_key: "6f72edf3ea7b80c9b65241b453e6fd26"
server_key_iv: "00647742a413ad387bb5bb3dc15ab2de"
server_key_version: "encryptionkey@0"
I20260806 10:42:19.002736 31634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:19.008415 31634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:19.009148 31634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:19.009402 31634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:19.010263 31634 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:42:19.011605 31634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:42:19.011700 31634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:19.011808 31634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:42:19.011880 31634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:19.043800 31634 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:34631
I20260806 10:42:19.043855 31818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:34631 every 8 connection(s)
I20260806 10:42:19.045192 31634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:42:19.050678 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 31634
I20260806 10:42:19.050886 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:42:19.051528 16565 external_mini_cluster.cc:1428] Setting key 4558c7d9c051aae39c786b9e79ccd70c
I20260806 10:42:19.053717 31822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:19.047921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:54475 (local address 127.16.45.126:42451)
0806 10:42:19.048361 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:19.048366 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:19.049671 (+ 1305us) server_negotiation.cc:407] Connection header received
0806 10:42:19.051479 (+ 1808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:19.051485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:19.051558 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:19.051688 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:19.052987 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:19.052992 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:19.052995 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:19.053011 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:19.053057 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:19.053069 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:19.053175 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:19.053363 (+ 188us) server_negotiation.cc:299] Negotiation successful
0806 10:42:19.053432 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":220,"threads_started":1}
I20260806 10:42:19.054246 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42451
--builtin_ntp_servers=127.16.45.84:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 10:42:19.054759 31823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:19.048554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42451 (local address 127.16.45.65:54475)
0806 10:42:19.049515 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:19.049553 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:19.051203 (+ 1650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:19.051924 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:19.051932 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:19.052026 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:19.052674 (+ 648us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:42:19.052677 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:19.052716 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:42:19.052805 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:42:19.053158 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:42:19.053169 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:42:19.053176 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 10:42:19.053442 (+ 266us) client_negotiation.cc:240] Negotiation successful
0806 10:42:19.053701 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":299,"threads_started":1}
I20260806 10:42:19.056277 31819 heartbeater.cc:347] Connected to a master server at 127.16.45.126:42451
I20260806 10:42:19.056561 31819 heartbeater.cc:464] Registering TS with master...
I20260806 10:42:19.057129 31819 heartbeater.cc:511] Master 127.16.45.126:42451 requested a full tablet report, sending...
I20260806 10:42:19.059650 31543 ts_manager.cc:194] Registered new tserver with Master: d8e37e890a3143aa92719fb43de1caad (127.16.45.65:34631)
W20260806 10:42:19.385532 31824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:19.385836 31824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:19.385967 31824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:19.393428 31824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:19.393544 31824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:19.393683 31824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:42:19.403331 31824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42451
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:19.404695 31824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:19.406601 31824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:19.419727 31834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:19.419751 31835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:19.419967 31837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:19.420554 31824 server_base.cc:1034] running on GCE node
I20260806 10:42:19.421236 31824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:19.422232 31824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:19.423487 31824 hybrid_clock.cc:648] HybridClock initialized: now 1786012939423417 us; error 63 us; skew 500 ppm
I20260806 10:42:19.423832 31824 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:42:19.426456 31824 webserver.cc:460] Webserver started at http://127.16.45.66:40731/ using document root <none> and password file <none>
I20260806 10:42:19.427198 31824 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:19.427307 31824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:19.427625 31824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:42:19.430701 31824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "1c579859c06545cf9e3bbdf494e09a5c"
format_stamp: "Formatted at 2026-08-06 10:42:19 on dist-test-slave-fgb3"
server_key: "678b4a558f2e0a8d4829c8b56d774c9b"
server_key_iv: "48c02ad8fb7602809ba489695b4bfdad"
server_key_version: "encryptionkey@0"
I20260806 10:42:19.431567 31824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "1c579859c06545cf9e3bbdf494e09a5c"
format_stamp: "Formatted at 2026-08-06 10:42:19 on dist-test-slave-fgb3"
server_key: "678b4a558f2e0a8d4829c8b56d774c9b"
server_key_iv: "48c02ad8fb7602809ba489695b4bfdad"
server_key_version: "encryptionkey@0"
I20260806 10:42:19.437213 31824 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 10:42:19.441072 31843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:19.442634 31824 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:42:19.442809 31824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "1c579859c06545cf9e3bbdf494e09a5c"
format_stamp: "Formatted at 2026-08-06 10:42:19 on dist-test-slave-fgb3"
server_key: "678b4a558f2e0a8d4829c8b56d774c9b"
server_key_iv: "48c02ad8fb7602809ba489695b4bfdad"
server_key_version: "encryptionkey@0"
I20260806 10:42:19.443037 31824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:19.448923 31824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:19.449755 31824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:19.450016 31824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:19.451048 31824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:42:19.452560 31824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:42:19.452659 31824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:19.452772 31824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:42:19.452842 31824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:19.485796 31824 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:43569
I20260806 10:42:19.485852 32015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:43569 every 8 connection(s)
I20260806 10:42:19.487208 31824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:42:19.492614 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 31824
I20260806 10:42:19.492777 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:42:19.493211 16565 external_mini_cluster.cc:1428] Setting key 4da1607fa50420a76203e29f475d66b1
I20260806 10:42:19.495601 31822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:19.489824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:42509 (local address 127.16.45.126:42451)
0806 10:42:19.490033 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:19.490038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:19.491521 (+ 1483us) server_negotiation.cc:407] Connection header received
0806 10:42:19.493269 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:19.493276 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:19.493357 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:19.493476 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:19.494831 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:19.494836 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:19.494840 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:19.494856 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:19.494890 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:19.494901 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:19.495012 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:19.495240 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 10:42:19.495306 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 10:42:19.496338 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42451
--builtin_ntp_servers=127.16.45.84:45039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 10:42:19.496687 32022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:19.490345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42451 (local address 127.16.45.66:42509)
0806 10:42:19.491370 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:19.491407 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:19.493006 (+ 1599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:19.493670 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:19.493678 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:19.493783 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:19.494536 (+ 753us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:42:19.494539 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:19.494578 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:42:19.494665 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:42:19.495016 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:42:19.495028 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:42:19.495037 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 10:42:19.495339 (+ 302us) client_negotiation.cc:240] Negotiation successful
0806 10:42:19.495565 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":324,"threads_started":1}
I20260806 10:42:19.498171 32018 heartbeater.cc:347] Connected to a master server at 127.16.45.126:42451
I20260806 10:42:19.498502 32018 heartbeater.cc:464] Registering TS with master...
I20260806 10:42:19.499176 32018 heartbeater.cc:511] Master 127.16.45.126:42451 requested a full tablet report, sending...
I20260806 10:42:19.500728 31543 ts_manager.cc:194] Registered new tserver with Master: 1c579859c06545cf9e3bbdf494e09a5c (127.16.45.66:43569)
W20260806 10:42:19.828156 32023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:19.828454 32023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:19.828569 32023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:19.835891 32023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:19.836004 32023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:19.836144 32023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:42:19.845582 32023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42451
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:19.847081 32023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:19.848960 32023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:19.861850 32032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:19.862076 32031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:19.862071 32035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:19.862919 32023 server_base.cc:1034] running on GCE node
I20260806 10:42:19.863533 32023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:19.864497 32023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:19.865706 32023 hybrid_clock.cc:648] HybridClock initialized: now 1786012939865652 us; error 49 us; skew 500 ppm
I20260806 10:42:19.866016 32023 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:42:19.871296 32023 webserver.cc:460] Webserver started at http://127.16.45.67:41581/ using document root <none> and password file <none>
I20260806 10:42:19.872051 32023 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:19.872159 32023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:19.872478 32023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:42:19.875379 32023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "71fa96404204444ab526d02028dbbd57"
format_stamp: "Formatted at 2026-08-06 10:42:19 on dist-test-slave-fgb3"
server_key: "583155c394a3207d958e38f1b940de35"
server_key_iv: "22fa3763045c7be05feafaaa89fe79f4"
server_key_version: "encryptionkey@0"
I20260806 10:42:19.876156 32023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "71fa96404204444ab526d02028dbbd57"
format_stamp: "Formatted at 2026-08-06 10:42:19 on dist-test-slave-fgb3"
server_key: "583155c394a3207d958e38f1b940de35"
server_key_iv: "22fa3763045c7be05feafaaa89fe79f4"
server_key_version: "encryptionkey@0"
I20260806 10:42:19.881193 32023 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:42:19.884519 32043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:19.885790 32023 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:42:19.885943 32023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "71fa96404204444ab526d02028dbbd57"
format_stamp: "Formatted at 2026-08-06 10:42:19 on dist-test-slave-fgb3"
server_key: "583155c394a3207d958e38f1b940de35"
server_key_iv: "22fa3763045c7be05feafaaa89fe79f4"
server_key_version: "encryptionkey@0"
I20260806 10:42:19.886145 32023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:19.891747 32023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:19.892522 32023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:19.892771 32023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:19.893656 32023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:42:19.895067 32023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:42:19.895161 32023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:19.895267 32023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:42:19.895344 32023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:19.925827 32023 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:33279
I20260806 10:42:19.925901 32214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:33279 every 8 connection(s)
I20260806 10:42:19.927111 32023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:42:19.934252 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 32023
I20260806 10:42:19.934489 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:42:19.935091 16565 external_mini_cluster.cc:1428] Setting key 721b7fe9be890a57bfa412db936af41f
I20260806 10:42:19.935385 31822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:19.929758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:49891 (local address 127.16.45.126:42451)
0806 10:42:19.929947 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:19.929952 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:19.931291 (+ 1339us) server_negotiation.cc:407] Connection header received
0806 10:42:19.933064 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:19.933071 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:19.933142 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:19.933249 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:19.934673 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:19.934679 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:19.934682 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:19.934698 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:19.934734 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:19.934746 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:19.934856 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:19.935066 (+ 210us) server_negotiation.cc:299] Negotiation successful
0806 10:42:19.935117 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 10:42:19.936582 32221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:19.930185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42451 (local address 127.16.45.67:49891)
0806 10:42:19.931127 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:19.931164 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:19.932777 (+ 1613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:19.933496 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:19.933504 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:19.933591 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:19.934295 (+ 704us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:42:19.934299 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:19.934374 (+ 75us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:42:19.934502 (+ 128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:42:19.934847 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:42:19.934858 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:42:19.934866 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 10:42:19.935171 (+ 305us) client_negotiation.cc:240] Negotiation successful
0806 10:42:19.935447 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":305,"threads_started":1}
I20260806 10:42:19.937881 32217 heartbeater.cc:347] Connected to a master server at 127.16.45.126:42451
I20260806 10:42:19.938174 32217 heartbeater.cc:464] Registering TS with master...
I20260806 10:42:19.938824 32217 heartbeater.cc:511] Master 127.16.45.126:42451 requested a full tablet report, sending...
I20260806 10:42:19.940261 31542 ts_manager.cc:194] Registered new tserver with Master: 71fa96404204444ab526d02028dbbd57 (127.16.45.67:33279)
I20260806 10:42:19.950850 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 10:42:19.957005 31822 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:42:19.955403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42090 (local address 127.16.45.126:42451)
0806 10:42:19.955604 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:19.955611 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:19.956133 (+ 522us) server_negotiation.cc:407] Connection header received
0806 10:42:19.956261 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:19.956265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:19.956320 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:19.956431 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:19.956752 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42090: BlockingRecv error: recv got EOF from 127.0.0.1:42090 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 10:42:19.957917 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 31634
I20260806 10:42:19.961228 32229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:19.958793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60180 (local address 127.16.45.65:34631)
0806 10:42:19.959290 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:19.959296 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:19.959351 (+ 55us) server_negotiation.cc:407] Connection header received
0806 10:42:19.959409 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:19.959414 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:19.959619 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:19.959744 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:19.960571 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:19.960578 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:19.960590 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:19.960601 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:19.960644 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:19.960660 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:19.960762 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:19.960924 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 10:42:19.961011 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":213,"threads_started":1}
I20260806 10:42:19.962522 31814 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:20.043831 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 31634
I20260806 10:42:20.064457 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 31824
I20260806 10:42:20.068421 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:20.065575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36274 (local address 127.16.45.66:43569)
0806 10:42:20.066098 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:20.066105 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:20.066132 (+ 27us) server_negotiation.cc:407] Connection header received
0806 10:42:20.066208 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:20.066215 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:20.066494 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:20.066629 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:20.067576 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:20.067584 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:20.067596 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:20.067632 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:20.067689 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:20.067707 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:20.067826 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:20.067979 (+ 153us) server_negotiation.cc:299] Negotiation successful
0806 10:42:20.068075 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":247,"threads_started":1}
I20260806 10:42:20.069721 32010 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:20.150365 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 31824
I20260806 10:42:20.169453 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 32023
I20260806 10:42:20.173339 32233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:20.170504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49566 (local address 127.16.45.67:33279)
0806 10:42:20.171294 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:20.171301 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:20.171335 (+ 34us) server_negotiation.cc:407] Connection header received
0806 10:42:20.171398 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:20.171405 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:20.171617 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:20.171742 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:20.172654 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:20.172660 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:20.172671 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:42:20.172688 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:20.172726 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:42:20.172740 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:20.172871 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:20.172922 (+ 51us) server_negotiation.cc:299] Negotiation successful
0806 10:42:20.173010 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":402,"threads_started":1}
I20260806 10:42:20.174693 32210 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:20.255836 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 32023
I20260806 10:42:20.272927 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 31503
I20260806 10:42:20.274235 31593 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:20.376957 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 31503
2026-08-06T10:42:20Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2373 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:42:20 dist-test-slave-fgb3 krb5kdc[32239](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:42:20 dist-test-slave-fgb3 krb5kdc[32239](info): set up 2 sockets
Aug 06 10:42:20 dist-test-slave-fgb3 krb5kdc[32239](info): commencing operation
krb5kdc: starting...
W20260806 10:42:21.576370 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.004s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:42:21 dist-test-slave-fgb3 krb5kdc[32239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:42:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:42:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:42:21.853964 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:37073
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:37449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:37073
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:42:22.196873 32256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:22.197199 32256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:22.197317 32256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:22.204968 32256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:42:22.205118 32256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:22.205178 32256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:22.205251 32256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:42:22.205375 32256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:42:22.216065 32256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:37449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:37073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:37073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:22.217651 32256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:22.219055 32256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:22.231122 32265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:22.231088 32267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:22.231158 32264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:22.231948 32256 server_base.cc:1034] running on GCE node
I20260806 10:42:22.232678 32256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:22.234023 32256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:22.235221 32256 hybrid_clock.cc:648] HybridClock initialized: now 1786012942235178 us; error 31 us; skew 500 ppm
I20260806 10:42:22.235572 32256 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:42:22 dist-test-slave-fgb3 krb5kdc[32239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012942, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:42:22.238636 32256 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:42:22.240057 32256 webserver.cc:460] Webserver started at http://127.16.45.126:38209/ using document root <none> and password file <none>
I20260806 10:42:22.240713 32256 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:22.240839 32256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:22.241138 32256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:42:22.244113 32256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "f5fd27ca751547d19ee76577dbb85449"
format_stamp: "Formatted at 2026-08-06 10:42:22 on dist-test-slave-fgb3"
server_key: "1d37110c21569ec4bd016ea0a60de27b"
server_key_iv: "0f16c944c6651410810d3e787062e9a1"
server_key_version: "encryptionkey@0"
I20260806 10:42:22.244882 32256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "f5fd27ca751547d19ee76577dbb85449"
format_stamp: "Formatted at 2026-08-06 10:42:22 on dist-test-slave-fgb3"
server_key: "1d37110c21569ec4bd016ea0a60de27b"
server_key_iv: "0f16c944c6651410810d3e787062e9a1"
server_key_version: "encryptionkey@0"
I20260806 10:42:22.249974 32256 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:42:22.253388 32275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:22.254657 32256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:42:22.254810 32256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "f5fd27ca751547d19ee76577dbb85449"
format_stamp: "Formatted at 2026-08-06 10:42:22 on dist-test-slave-fgb3"
server_key: "1d37110c21569ec4bd016ea0a60de27b"
server_key_iv: "0f16c944c6651410810d3e787062e9a1"
server_key_version: "encryptionkey@0"
I20260806 10:42:22.254997 32256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:22.274796 32256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:22.279206 32256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:22.279497 32256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:22.298355 32256 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:37073
I20260806 10:42:22.298431 32358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:37073 every 8 connection(s)
I20260806 10:42:22.299752 32256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:42:22.301476 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 32256
I20260806 10:42:22.301692 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:42:22.302330 16565 external_mini_cluster.cc:1428] Setting key 371d3b260b7cb4ee972b448a8c27c851
I20260806 10:42:22.303733 32359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 10:42:22 dist-test-slave-fgb3 krb5kdc[32239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:42:22.317593 32359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449: Bootstrap starting.
I20260806 10:42:22.321645 32359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449: Neither blocks nor log segments found. Creating new log.
I20260806 10:42:22.322928 32359 log.cc:824] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449: Log is configured to *not* fsync() on all Append() calls
I20260806 10:42:22.326272 32359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449: No bootstrap required, opened a new log
I20260806 10:42:22.326538 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:22.304184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48402 (local address 127.16.45.126:37073)
0806 10:42:22.304968 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:22.304985 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:22.305042 (+ 57us) server_negotiation.cc:407] Connection header received
0806 10:42:22.307119 (+ 2077us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:22.307149 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:22.307695 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:22.308155 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:22.309598 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:22.311641 (+ 2043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:22.312957 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:22.313988 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:22.314204 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:22.318277 (+ 4073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:22.318288 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:22.318307 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:42:22.318393 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:22.322151 (+ 3758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:22.322867 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:22.322877 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:22.322886 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:22.323125 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:22.323516 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:22.323521 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:22.323525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:22.324119 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:22.324413 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:22.324782 (+ 369us) server_negotiation.cc:299] Negotiation successful
0806 10:42:22.325203 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":315,"threads_started":1}
I20260806 10:42:22.333559 32359 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5fd27ca751547d19ee76577dbb85449" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37073 } }
I20260806 10:42:22.333894 32359 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:42:22.333976 32359 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5fd27ca751547d19ee76577dbb85449, State: Initialized, Role: FOLLOWER
I20260806 10:42:22.334515 32359 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5fd27ca751547d19ee76577dbb85449" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37073 } }
I20260806 10:42:22.334733 32359 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:42:22.334870 32359 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:42:22.335038 32359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:42:22.337216 32359 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5fd27ca751547d19ee76577dbb85449" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37073 } }
I20260806 10:42:22.337684 32359 leader_election.cc:302] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5fd27ca751547d19ee76577dbb85449; no voters:
I20260806 10:42:22.338253 32359 leader_election.cc:288] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:42:22.338403 32370 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:42:22.339067 32370 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [term 1 LEADER]: Becoming Leader. State: Replica: f5fd27ca751547d19ee76577dbb85449, State: Running, Role: LEADER
I20260806 10:42:22.339603 32370 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5fd27ca751547d19ee76577dbb85449" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37073 } }
I20260806 10:42:22.340288 32359 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:42:22.342264 32373 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5fd27ca751547d19ee76577dbb85449" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5fd27ca751547d19ee76577dbb85449" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37073 } } }
I20260806 10:42:22.342669 32373 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [sys.catalog]: This master's current role is: LEADER
I20260806 10:42:22.343322 32374 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5fd27ca751547d19ee76577dbb85449. Latest consensus state: current_term: 1 leader_uuid: "f5fd27ca751547d19ee76577dbb85449" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5fd27ca751547d19ee76577dbb85449" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 37073 } } }
I20260806 10:42:22.343662 32374 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449 [sys.catalog]: This master's current role is: LEADER
I20260806 10:42:22.344450 32380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:42:22.348922 32380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:42:22.357116 32380 catalog_manager.cc:1347] Generated new cluster ID: dcfa088d4fbf407a9eb2dde39d4779cd
I20260806 10:42:22.357232 32380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:42:22.368966 32380 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:42:22.370877 32380 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:42:22.379307 32380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449: Generated new TSK 0
I20260806 10:42:22.380383 32380 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:42:22.442255 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:37073
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:37449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:42:22.771770 32400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:22.772044 32400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:22.772149 32400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:22.779356 32400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:22.779474 32400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:22.779592 32400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:42:22.789358 32400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:37449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:37073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:22.790709 32400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:22.792042 32400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:22.804548 32415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:22.804615 32408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:22.804636 32409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:22.805584 32400 server_base.cc:1034] running on GCE node
I20260806 10:42:22.806182 32400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:22.807153 32400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:22.808389 32400 hybrid_clock.cc:648] HybridClock initialized: now 1786012942808309 us; error 87 us; skew 500 ppm
I20260806 10:42:22.808758 32400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:42:22 dist-test-slave-fgb3 krb5kdc[32239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012942, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:42:22.811852 32400 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:42:22.813246 32400 webserver.cc:460] Webserver started at http://127.16.45.65:42811/ using document root <none> and password file <none>
I20260806 10:42:22.813918 32400 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:22.814033 32400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:22.814344 32400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:42:22.817217 32400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "f94026d208c74ef194220ac4823c16ec"
format_stamp: "Formatted at 2026-08-06 10:42:22 on dist-test-slave-fgb3"
server_key: "6fb253533b91fc42593569c8de611d7c"
server_key_iv: "c826a5a8d02c17260935dd1c16797c7a"
server_key_version: "encryptionkey@0"
I20260806 10:42:22.817988 32400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "f94026d208c74ef194220ac4823c16ec"
format_stamp: "Formatted at 2026-08-06 10:42:22 on dist-test-slave-fgb3"
server_key: "6fb253533b91fc42593569c8de611d7c"
server_key_iv: "c826a5a8d02c17260935dd1c16797c7a"
server_key_version: "encryptionkey@0"
I20260806 10:42:22.823063 32400 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 10:42:22.826599 32428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:22.827908 32400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:42:22.828063 32400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "f94026d208c74ef194220ac4823c16ec"
format_stamp: "Formatted at 2026-08-06 10:42:22 on dist-test-slave-fgb3"
server_key: "6fb253533b91fc42593569c8de611d7c"
server_key_iv: "c826a5a8d02c17260935dd1c16797c7a"
server_key_version: "encryptionkey@0"
I20260806 10:42:22.828229 32400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:22.854848 32400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:22.859088 32400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:22.859377 32400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:22.860371 32400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:42:22.861752 32400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:42:22.861838 32400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:22.861966 32400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:42:22.862018 32400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:22.892706 32400 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:46657
I20260806 10:42:22.892755 32596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:46657 every 8 connection(s)
I20260806 10:42:22.893973 32400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:42:22.899534 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 32400
I20260806 10:42:22.899782 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:42:22.900607 16565 external_mini_cluster.cc:1428] Setting key 4598797911bbd668731f43e2f44b3756
Aug 06 10:42:22 dist-test-slave-fgb3 krb5kdc[32239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012942, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:42:22.915654 32599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:22.896565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:58407 (local address 127.16.45.126:37073)
0806 10:42:22.897022 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:22.897026 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:22.897722 (+ 696us) server_negotiation.cc:407] Connection header received
0806 10:42:22.899770 (+ 2048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:22.899775 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:22.899851 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:22.899960 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:22.901903 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:22.903089 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:22.905289 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:22.905701 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:22.905864 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:22.909999 (+ 4135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:22.910006 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:22.910009 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:42:22.910046 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:22.912551 (+ 2505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:22.913379 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:22.913383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:22.913386 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:22.913502 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:22.913924 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:22.913926 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:22.913928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:22.914181 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:22.914293 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:22.915049 (+ 756us) server_negotiation.cc:299] Negotiation successful
0806 10:42:22.915285 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":231,"threads_started":1}
I20260806 10:42:22.916455 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:22.896856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:37073 (local address 127.16.45.65:58407)
0806 10:42:22.897560 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:22.897608 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:22.899444 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:22.900255 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:22.900267 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:22.900989 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:22.901697 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:22.901723 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:22.903267 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:22.903272 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:22.905096 (+ 1824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:22.905111 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:22.905990 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:22.905997 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:22.906271 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:22.907135 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:22.907161 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:22.909726 (+ 2565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:42:22.912690 (+ 2964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:42:22.912698 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:42:22.912715 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:42:22.913280 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:42:22.913592 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:42:22.913596 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:42:22.913600 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:42:22.913834 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:42:22.914297 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:42:22.914305 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:42:22.914678 (+ 373us) client_negotiation.cc:769] Sending connection context
0806 10:42:22.914910 (+ 232us) client_negotiation.cc:240] Negotiation successful
0806 10:42:22.915324 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":256,"threads_started":1}
I20260806 10:42:22.917907 32597 heartbeater.cc:347] Connected to a master server at 127.16.45.126:37073
I20260806 10:42:22.918219 32597 heartbeater.cc:464] Registering TS with master...
I20260806 10:42:22.918957 32597 heartbeater.cc:511] Master 127.16.45.126:37073 requested a full tablet report, sending...
I20260806 10:42:22.921044 32304 ts_manager.cc:194] Registered new tserver with Master: f94026d208c74ef194220ac4823c16ec (127.16.45.65:46657)
I20260806 10:42:22.922613 32304 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:58407
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:42:22.963151 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:37073
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:37449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:42:23.299461 32605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:23.299755 32605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:23.299906 32605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:23.307474 32605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:23.307603 32605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:23.307766 32605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:42:23.321405 32605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:37449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:37073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:23.323370 32605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:23.324916 32605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:23.338215 32613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:23.338145 32616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:23.338371 32618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:23.338876 32605 server_base.cc:1034] running on GCE node
I20260806 10:42:23.339452 32605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:23.340353 32605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:23.341578 32605 hybrid_clock.cc:648] HybridClock initialized: now 1786012943341511 us; error 52 us; skew 500 ppm
I20260806 10:42:23.341909 32605 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:42:23 dist-test-slave-fgb3 krb5kdc[32239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012943, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:42:23.345151 32605 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:42:23.346724 32605 webserver.cc:460] Webserver started at http://127.16.45.66:35199/ using document root <none> and password file <none>
I20260806 10:42:23.347409 32605 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:23.347532 32605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:23.347834 32605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:42:23.350732 32605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "b055e850a48d4f05bb26c690b6cee190"
format_stamp: "Formatted at 2026-08-06 10:42:23 on dist-test-slave-fgb3"
server_key: "4211259a7a1d0316402864123047bcc8"
server_key_iv: "0fdf7f48eb267e15a05a65f707a31e0f"
server_key_version: "encryptionkey@0"
I20260806 10:42:23.351486 32605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "b055e850a48d4f05bb26c690b6cee190"
format_stamp: "Formatted at 2026-08-06 10:42:23 on dist-test-slave-fgb3"
server_key: "4211259a7a1d0316402864123047bcc8"
server_key_iv: "0fdf7f48eb267e15a05a65f707a31e0f"
server_key_version: "encryptionkey@0"
I20260806 10:42:23.356424 32605 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 10:42:23.359818 32630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:23.361091 32605 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 10:42:23.361248 32605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "b055e850a48d4f05bb26c690b6cee190"
format_stamp: "Formatted at 2026-08-06 10:42:23 on dist-test-slave-fgb3"
server_key: "4211259a7a1d0316402864123047bcc8"
server_key_iv: "0fdf7f48eb267e15a05a65f707a31e0f"
server_key_version: "encryptionkey@0"
I20260806 10:42:23.361434 32605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:23.373850 32605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:23.377955 32605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:23.378249 32605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:23.379231 32605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:42:23.380556 32605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:42:23.380636 32605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:23.380755 32605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:42:23.380807 32605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:23.412420 32605 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:46457
I20260806 10:42:23.412480 324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:46457 every 8 connection(s)
I20260806 10:42:23.413728 32605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:42:23.423774 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 32605
I20260806 10:42:23.423974 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:42:23.424438 16565 external_mini_cluster.cc:1428] Setting key 683b0fb05037293c6a024e381a6d96e2
Aug 06 10:42:23 dist-test-slave-fgb3 krb5kdc[32239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012943, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:42:23.434538 331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:23.416471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:49689 (local address 127.16.45.126:37073)
0806 10:42:23.416870 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:23.416874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:23.417914 (+ 1040us) server_negotiation.cc:407] Connection header received
0806 10:42:23.419811 (+ 1897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:23.419817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:23.419908 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:23.420007 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:23.421618 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:23.422377 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:23.424006 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:23.424497 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:23.424621 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:23.428681 (+ 4060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:23.428686 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:23.428689 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:42:23.428726 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:23.431299 (+ 2573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:23.432104 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:23.432108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:23.432110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:23.432248 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:23.432707 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:23.432711 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:23.432714 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:23.433004 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:23.433146 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:23.433887 (+ 741us) server_negotiation.cc:299] Negotiation successful
0806 10:42:23.434129 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":201,"threads_started":1}
I20260806 10:42:23.435572 332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:23.417014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:37073 (local address 127.16.45.66:49689)
0806 10:42:23.417744 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:23.417787 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:23.419527 (+ 1740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:23.420261 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:23.420270 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:23.420800 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:23.421430 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:23.421450 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:23.422539 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:23.422543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:23.423835 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:23.423854 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:23.424749 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:23.424758 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:23.425077 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:23.425792 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:23.425816 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:23.428441 (+ 2625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:42:23.431455 (+ 3014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:42:23.431465 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:42:23.431485 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:42:23.431980 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:42:23.432364 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:42:23.432369 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:42:23.432373 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:42:23.432577 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:42:23.433137 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:42:23.433146 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:42:23.433514 (+ 368us) client_negotiation.cc:769] Sending connection context
0806 10:42:23.433771 (+ 257us) client_negotiation.cc:240] Negotiation successful
0806 10:42:23.434395 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":282,"threads_started":1}
I20260806 10:42:23.437085 328 heartbeater.cc:347] Connected to a master server at 127.16.45.126:37073
I20260806 10:42:23.437407 328 heartbeater.cc:464] Registering TS with master...
I20260806 10:42:23.438170 328 heartbeater.cc:511] Master 127.16.45.126:37073 requested a full tablet report, sending...
I20260806 10:42:23.439669 32304 ts_manager.cc:194] Registered new tserver with Master: b055e850a48d4f05bb26c690b6cee190 (127.16.45.66:46457)
I20260806 10:42:23.440511 32304 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:49689
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:42:23.485921 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:37073
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:37449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:42:23.816461 335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:42:23.816748 335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:42:23.816843 335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:42:23.824061 335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:42:23.824185 335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:42:23.824309 335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:42:23.834255 335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:37449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:37073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:42:23.835547 335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:42:23.836826 335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:42:23.849962 342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:23.850006 341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:42:23.849925 344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:42:23.855911 335 server_base.cc:1034] running on GCE node
I20260806 10:42:23.856609 335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:42:23.857589 335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:42:23.858795 335 hybrid_clock.cc:648] HybridClock initialized: now 1786012943858724 us; error 61 us; skew 500 ppm
I20260806 10:42:23.859143 335 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:42:23 dist-test-slave-fgb3 krb5kdc[32239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012943, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:42:23.862273 335 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:42:23.863900 335 webserver.cc:460] Webserver started at http://127.16.45.67:40419/ using document root <none> and password file <none>
I20260806 10:42:23.864676 335 fs_manager.cc:359] Metadata directory not provided
I20260806 10:42:23.864799 335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:42:23.865118 335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:42:23.868228 335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "163e0b2e75ac482a9a2a305b36a304de"
format_stamp: "Formatted at 2026-08-06 10:42:23 on dist-test-slave-fgb3"
server_key: "095370d5858736bdb12c4b4fa3ca46c3"
server_key_iv: "d63a8e7589ea7d7a5c486ed29cf01a61"
server_key_version: "encryptionkey@0"
I20260806 10:42:23.869030 335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "163e0b2e75ac482a9a2a305b36a304de"
format_stamp: "Formatted at 2026-08-06 10:42:23 on dist-test-slave-fgb3"
server_key: "095370d5858736bdb12c4b4fa3ca46c3"
server_key_iv: "d63a8e7589ea7d7a5c486ed29cf01a61"
server_key_version: "encryptionkey@0"
I20260806 10:42:23.874408 335 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 10:42:23.877918 358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:23.879433 335 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:42:23.879606 335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "163e0b2e75ac482a9a2a305b36a304de"
format_stamp: "Formatted at 2026-08-06 10:42:23 on dist-test-slave-fgb3"
server_key: "095370d5858736bdb12c4b4fa3ca46c3"
server_key_iv: "d63a8e7589ea7d7a5c486ed29cf01a61"
server_key_version: "encryptionkey@0"
I20260806 10:42:23.879801 335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:42:23.905150 335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:42:23.909426 335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:42:23.909709 335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:42:23.910705 335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:42:23.912107 335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:42:23.912189 335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:23.912318 335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:42:23.912374 335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:42:23.925616 32597 heartbeater.cc:503] Master 127.16.45.126:37073 was elected leader, sending a full tablet report...
I20260806 10:42:23.946458 335 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:43257
I20260806 10:42:23.946518 520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:43257 every 8 connection(s)
I20260806 10:42:23.947767 335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:42:23.954828 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 335
I20260806 10:42:23.955016 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:42:23.955438 16565 external_mini_cluster.cc:1428] Setting key 23795affafad1c979b06616589e06ce9
Aug 06 10:42:23 dist-test-slave-fgb3 krb5kdc[32239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012943, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:42:23.967259 524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:23.950380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:44897 (local address 127.16.45.126:37073)
0806 10:42:23.950823 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:23.950828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:23.951693 (+ 865us) server_negotiation.cc:407] Connection header received
0806 10:42:23.953523 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:23.953529 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:23.953607 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:23.953703 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:23.955282 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:23.956162 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:23.957694 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:23.958155 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:23.958279 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:23.961616 (+ 3337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:23.961621 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:23.961625 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:42:23.961658 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:23.964206 (+ 2548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:23.964961 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:23.964964 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:23.964967 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:23.965102 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:23.965505 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:23.965508 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:23.965510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:23.965818 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:23.965971 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:23.966678 (+ 707us) server_negotiation.cc:299] Negotiation successful
0806 10:42:23.966899 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":210,"threads_started":1}
I20260806 10:42:23.968148 525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:23.950856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:37073 (local address 127.16.45.67:44897)
0806 10:42:23.951536 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:23.951580 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:23.953244 (+ 1664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:23.953945 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:23.953953 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:23.954498 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:42:23.955091 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:23.955115 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:23.956314 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:23.956320 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:23.957550 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:23.957562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:23.958400 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:23.958408 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:23.958653 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:23.959313 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:42:23.959338 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:42:23.961416 (+ 2078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:42:23.964356 (+ 2940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:42:23.964365 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:42:23.964379 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:42:23.964840 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:42:23.965204 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:42:23.965207 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:42:23.965209 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:42:23.965391 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:42:23.965949 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:42:23.965957 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:42:23.966275 (+ 318us) client_negotiation.cc:769] Sending connection context
0806 10:42:23.966552 (+ 277us) client_negotiation.cc:240] Negotiation successful
0806 10:42:23.967069 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":258,"threads_started":1}
I20260806 10:42:23.969645 522 heartbeater.cc:347] Connected to a master server at 127.16.45.126:37073
I20260806 10:42:23.969937 522 heartbeater.cc:464] Registering TS with master...
I20260806 10:42:23.970721 522 heartbeater.cc:511] Master 127.16.45.126:37073 requested a full tablet report, sending...
I20260806 10:42:23.972121 32304 ts_manager.cc:194] Registered new tserver with Master: 163e0b2e75ac482a9a2a305b36a304de (127.16.45.67:43257)
I20260806 10:42:23.972904 32304 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:44897
I20260806 10:42:23.982734 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:42:23.999662 524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:23.987387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58248 (local address 127.16.45.126:37073)
0806 10:42:23.987541 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:23.987545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:23.987964 (+ 419us) server_negotiation.cc:407] Connection header received
0806 10:42:23.988111 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:23.988114 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:23.988194 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:23.988268 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:23.989611 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:23.990393 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:23.991660 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:23.992081 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:23.992182 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:23.994478 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:23.994483 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:23.994486 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:42:23.994518 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:23.997011 (+ 2493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:23.997682 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:23.997686 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:23.997689 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:23.997826 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:23.998153 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:23.998156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:23.998158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:23.998528 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:23.998720 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:23.999195 (+ 475us) server_negotiation.cc:299] Negotiation successful
0806 10:42:23.999426 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 10:42:24.003821 32304 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58248:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:42:24.010715 32304 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:42:24.034801 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.024257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49980 (local address 127.16.45.67:43257)
0806 10:42:24.026291 (+ 2034us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:24.026298 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:24.026352 (+ 54us) server_negotiation.cc:407] Connection header received
0806 10:42:24.026456 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:24.026463 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:24.026673 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:24.026870 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:42:24.027812 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.029354 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.032237 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.033640 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.033772 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.034001 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:24.034247 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 10:42:24.034450 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1860,"thread_start_us":1658,"threads_started":1}
I20260806 10:42:24.035691 548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.023722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34418 (local address 127.16.45.66:46457)
0806 10:42:24.025908 (+ 2186us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:24.025918 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:24.025949 (+ 31us) server_negotiation.cc:407] Connection header received
0806 10:42:24.026052 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:24.026060 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:24.026346 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:24.027415 (+ 1069us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:42:24.027635 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.029242 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.032147 (+ 2905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.033196 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.033325 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.033563 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:24.034544 (+ 981us) server_negotiation.cc:299] Negotiation successful
0806 10:42:24.035476 (+ 932us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2018,"thread_start_us":1918,"threads_started":1}
I20260806 10:42:24.036007 547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.023532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:46457 (local address 127.0.0.1:34418)
0806 10:42:24.024872 (+ 1340us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:24.024909 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:24.025075 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:24.026604 (+ 1529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:24.026612 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:24.026644 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:42:24.027177 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:24.027189 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.029381 (+ 2192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.029387 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:24.031968 (+ 2581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:24.031982 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.033410 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.033417 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:24.033606 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.033651 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 10:42:24.033787 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 10:42:24.034009 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1070,"mutex_wait_us":3,"thread_start_us":1797,"threads_started":1}
I20260806 10:42:24.036399 546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.023647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:43257 (local address 127.0.0.1:49980)
0806 10:42:24.025599 (+ 1952us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:24.025616 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:24.025718 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:24.027163 (+ 1445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:24.027167 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:24.027192 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:42:24.027602 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:24.027617 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.029487 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.029491 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:24.032020 (+ 2529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:24.032033 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.033865 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.033872 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:24.034044 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.034074 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 10:42:24.034169 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 10:42:24.034291 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1825,"mutex_wait_us":25,"thread_start_us":959,"threads_started":1}
I20260806 10:42:24.037037 551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.026725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:46657 (local address 127.0.0.1:33630)
0806 10:42:24.027959 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:24.027977 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:24.028089 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:24.029238 (+ 1149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:24.029243 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:24.029266 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:42:24.029821 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:24.029838 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.031797 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.031802 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:24.033919 (+ 2117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:24.033934 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.036259 (+ 2325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.036266 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:24.036440 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.036471 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 10:42:24.036558 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 10:42:24.036685 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1117,"mutex_wait_us":1,"thread_start_us":985,"threads_started":1}
I20260806 10:42:24.037657 552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.027326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33630 (local address 127.16.45.65:46657)
0806 10:42:24.028607 (+ 1281us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:24.028613 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:24.028634 (+ 21us) server_negotiation.cc:407] Connection header received
0806 10:42:24.028707 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:24.028712 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:24.028866 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:24.029056 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:42:24.030074 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.031660 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.034096 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.035758 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.035892 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.036106 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:24.037272 (+ 1166us) server_negotiation.cc:299] Negotiation successful
0806 10:42:24.037437 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1138,"thread_start_us":989,"threads_started":1}
I20260806 10:42:24.040349 32495 tablet_service.cc:1467] Processing CreateTablet for tablet 31447ba8ae704827956e235f3d0f43cb (DEFAULT_TABLE table=test-table [id=7eeeb6c57498412dac6587150020f93f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:42:24.040328 427 tablet_service.cc:1467] Processing CreateTablet for tablet 31447ba8ae704827956e235f3d0f43cb (DEFAULT_TABLE table=test-table [id=7eeeb6c57498412dac6587150020f93f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:42:24.040328 32700 tablet_service.cc:1467] Processing CreateTablet for tablet 31447ba8ae704827956e235f3d0f43cb (DEFAULT_TABLE table=test-table [id=7eeeb6c57498412dac6587150020f93f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:42:24.041764 32495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31447ba8ae704827956e235f3d0f43cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:42:24.041769 427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31447ba8ae704827956e235f3d0f43cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:42:24.041769 32700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31447ba8ae704827956e235f3d0f43cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:42:24.053411 555 tablet_bootstrap.cc:492] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec: Bootstrap starting.
I20260806 10:42:24.056139 557 tablet_bootstrap.cc:492] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190: Bootstrap starting.
I20260806 10:42:24.058382 555 tablet_bootstrap.cc:654] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec: Neither blocks nor log segments found. Creating new log.
I20260806 10:42:24.059728 555 log.cc:824] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec: Log is configured to *not* fsync() on all Append() calls
I20260806 10:42:24.059794 557 tablet_bootstrap.cc:654] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190: Neither blocks nor log segments found. Creating new log.
I20260806 10:42:24.061045 557 log.cc:824] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190: Log is configured to *not* fsync() on all Append() calls
I20260806 10:42:24.061347 556 tablet_bootstrap.cc:492] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de: Bootstrap starting.
I20260806 10:42:24.064359 557 tablet_bootstrap.cc:492] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190: No bootstrap required, opened a new log
I20260806 10:42:24.064363 555 tablet_bootstrap.cc:492] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec: No bootstrap required, opened a new log
I20260806 10:42:24.064642 555 ts_tablet_manager.cc:1397] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260806 10:42:24.064677 557 ts_tablet_manager.cc:1397] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260806 10:42:24.064940 556 tablet_bootstrap.cc:654] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de: Neither blocks nor log segments found. Creating new log.
I20260806 10:42:24.066159 556 log.cc:824] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de: Log is configured to *not* fsync() on all Append() calls
I20260806 10:42:24.069245 556 tablet_bootstrap.cc:492] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de: No bootstrap required, opened a new log
I20260806 10:42:24.069520 556 ts_tablet_manager.cc:1397] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 10:42:24.072109 557 raft_consensus.cc:348] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b055e850a48d4f05bb26c690b6cee190" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46457 } } peers { permanent_uuid: "163e0b2e75ac482a9a2a305b36a304de" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 43257 } } peers { permanent_uuid: "f94026d208c74ef194220ac4823c16ec" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 46657 } }
I20260806 10:42:24.072470 557 raft_consensus.cc:374] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:42:24.072600 557 raft_consensus.cc:729] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b055e850a48d4f05bb26c690b6cee190, State: Initialized, Role: FOLLOWER
I20260806 10:42:24.073169 557 consensus_queue.cc:260] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b055e850a48d4f05bb26c690b6cee190" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46457 } } peers { permanent_uuid: "163e0b2e75ac482a9a2a305b36a304de" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 43257 } } peers { permanent_uuid: "f94026d208c74ef194220ac4823c16ec" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 46657 } }
I20260806 10:42:24.074465 555 raft_consensus.cc:348] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b055e850a48d4f05bb26c690b6cee190" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46457 } } peers { permanent_uuid: "163e0b2e75ac482a9a2a305b36a304de" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 43257 } } peers { permanent_uuid: "f94026d208c74ef194220ac4823c16ec" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 46657 } }
I20260806 10:42:24.074919 555 raft_consensus.cc:374] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:42:24.075048 555 raft_consensus.cc:729] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f94026d208c74ef194220ac4823c16ec, State: Initialized, Role: FOLLOWER
I20260806 10:42:24.075759 555 consensus_queue.cc:260] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b055e850a48d4f05bb26c690b6cee190" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46457 } } peers { permanent_uuid: "163e0b2e75ac482a9a2a305b36a304de" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 43257 } } peers { permanent_uuid: "f94026d208c74ef194220ac4823c16ec" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 46657 } }
I20260806 10:42:24.077631 555 ts_tablet_manager.cc:1428] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260806 10:42:24.078850 565 raft_consensus.cc:482] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:42:24.079164 565 raft_consensus.cc:504] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b055e850a48d4f05bb26c690b6cee190" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46457 } } peers { permanent_uuid: "163e0b2e75ac482a9a2a305b36a304de" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 43257 } } peers { permanent_uuid: "f94026d208c74ef194220ac4823c16ec" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 46657 } }
I20260806 10:42:24.079432 556 raft_consensus.cc:348] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b055e850a48d4f05bb26c690b6cee190" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46457 } } peers { permanent_uuid: "163e0b2e75ac482a9a2a305b36a304de" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 43257 } } peers { permanent_uuid: "f94026d208c74ef194220ac4823c16ec" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 46657 } }
I20260806 10:42:24.079860 556 raft_consensus.cc:374] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:42:24.079957 556 raft_consensus.cc:729] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 163e0b2e75ac482a9a2a305b36a304de, State: Initialized, Role: FOLLOWER
I20260806 10:42:24.080515 556 consensus_queue.cc:260] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b055e850a48d4f05bb26c690b6cee190" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46457 } } peers { permanent_uuid: "163e0b2e75ac482a9a2a305b36a304de" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 43257 } } peers { permanent_uuid: "f94026d208c74ef194220ac4823c16ec" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 46657 } }
I20260806 10:42:24.081647 328 heartbeater.cc:503] Master 127.16.45.126:37073 was elected leader, sending a full tablet report...
I20260806 10:42:24.084517 557 ts_tablet_manager.cc:1428] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190: Time spent starting tablet: real 0.020s user 0.012s sys 0.005s
I20260806 10:42:24.085152 522 heartbeater.cc:503] Master 127.16.45.126:37073 was elected leader, sending a full tablet report...
I20260806 10:42:24.086097 556 ts_tablet_manager.cc:1428] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de: Time spent starting tablet: real 0.016s user 0.013s sys 0.004s
I20260806 10:42:24.086752 565 leader_election.cc:288] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b055e850a48d4f05bb26c690b6cee190 (127.16.45.66:46457), 163e0b2e75ac482a9a2a305b36a304de (127.16.45.67:43257)
I20260806 10:42:24.093263 548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.082292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:50605 (local address 127.16.45.66:46457)
0806 10:42:24.082487 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:24.082494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:24.087506 (+ 5012us) server_negotiation.cc:407] Connection header received
0806 10:42:24.087824 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:24.087830 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:24.087906 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:24.087966 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:42:24.088713 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.089739 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.091579 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.092343 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.092476 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.092549 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:24.092901 (+ 352us) server_negotiation.cc:299] Negotiation successful
0806 10:42:24.093023 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 10:42:24.093394 567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.081674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:46457 (local address 127.16.45.65:50605)
0806 10:42:24.087411 (+ 5737us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:24.087427 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:24.087629 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:24.088162 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:24.088167 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:24.088186 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:42:24.088541 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:24.088555 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.089849 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.089854 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:24.091430 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:24.091443 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.092539 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.092546 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:24.092717 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.092772 (+ 55us) client_negotiation.cc:769] Sending connection context
0806 10:42:24.092850 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 10:42:24.092971 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5628,"mutex_wait_us":26,"thread_start_us":7328,"threads_started":1}
I20260806 10:42:24.093405 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.087878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:54809 (local address 127.16.45.67:43257)
0806 10:42:24.088080 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:24.088085 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:24.088103 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:42:24.088350 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:24.088356 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:24.088423 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:24.088483 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:42:24.089182 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.089967 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.091706 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.092457 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.092594 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.092664 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:24.093009 (+ 345us) server_negotiation.cc:299] Negotiation successful
0806 10:42:24.093134 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 10:42:24.093497 568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.087196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:43257 (local address 127.16.45.65:54809)
0806 10:42:24.087881 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0806 10:42:24.087897 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:42:24.088183 (+ 286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:42:24.088653 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:42:24.088657 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:42:24.088679 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:42:24.089040 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:24.089052 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.090116 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.090119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:24.091553 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:42:24.091566 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.092673 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.092679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:42:24.092868 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.092891 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 10:42:24.092967 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 10:42:24.093082 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"mutex_wait_us":45,"thread_start_us":1596,"threads_started":1}
I20260806 10:42:24.094398 32727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31447ba8ae704827956e235f3d0f43cb" candidate_uuid: "f94026d208c74ef194220ac4823c16ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b055e850a48d4f05bb26c690b6cee190" is_pre_election: true
I20260806 10:42:24.094398 461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31447ba8ae704827956e235f3d0f43cb" candidate_uuid: "f94026d208c74ef194220ac4823c16ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "163e0b2e75ac482a9a2a305b36a304de" is_pre_election: true
I20260806 10:42:24.094941 32727 raft_consensus.cc:2454] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f94026d208c74ef194220ac4823c16ec in term 0.
I20260806 10:42:24.094941 461 raft_consensus.cc:2454] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f94026d208c74ef194220ac4823c16ec in term 0.
I20260806 10:42:24.095643 32429 leader_election.cc:302] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 163e0b2e75ac482a9a2a305b36a304de, f94026d208c74ef194220ac4823c16ec; no voters:
I20260806 10:42:24.096024 565 raft_consensus.cc:2781] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:42:24.096153 565 raft_consensus.cc:482] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:42:24.096261 565 raft_consensus.cc:3037] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:42:24.098598 565 raft_consensus.cc:504] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b055e850a48d4f05bb26c690b6cee190" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46457 } } peers { permanent_uuid: "163e0b2e75ac482a9a2a305b36a304de" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 43257 } } peers { permanent_uuid: "f94026d208c74ef194220ac4823c16ec" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 46657 } }
I20260806 10:42:24.099174 565 leader_election.cc:288] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [CANDIDATE]: Term 1 election: Requested vote from peers b055e850a48d4f05bb26c690b6cee190 (127.16.45.66:46457), 163e0b2e75ac482a9a2a305b36a304de (127.16.45.67:43257)
I20260806 10:42:24.099691 32727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31447ba8ae704827956e235f3d0f43cb" candidate_uuid: "f94026d208c74ef194220ac4823c16ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b055e850a48d4f05bb26c690b6cee190"
I20260806 10:42:24.099715 461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31447ba8ae704827956e235f3d0f43cb" candidate_uuid: "f94026d208c74ef194220ac4823c16ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "163e0b2e75ac482a9a2a305b36a304de"
I20260806 10:42:24.099913 461 raft_consensus.cc:3037] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:42:24.099915 32727 raft_consensus.cc:3037] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:42:24.103122 461 raft_consensus.cc:2454] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f94026d208c74ef194220ac4823c16ec in term 1.
I20260806 10:42:24.103122 32727 raft_consensus.cc:2454] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f94026d208c74ef194220ac4823c16ec in term 1.
I20260806 10:42:24.103554 32429 leader_election.cc:302] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 163e0b2e75ac482a9a2a305b36a304de, f94026d208c74ef194220ac4823c16ec; no voters:
I20260806 10:42:24.103852 565 raft_consensus.cc:2781] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:42:24.104336 565 raft_consensus.cc:686] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 1 LEADER]: Becoming Leader. State: Replica: f94026d208c74ef194220ac4823c16ec, State: Running, Role: LEADER
I20260806 10:42:24.104879 565 consensus_queue.cc:237] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b055e850a48d4f05bb26c690b6cee190" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46457 } } peers { permanent_uuid: "163e0b2e75ac482a9a2a305b36a304de" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 43257 } } peers { permanent_uuid: "f94026d208c74ef194220ac4823c16ec" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 46657 } }
I20260806 10:42:24.109512 32304 catalog_manager.cc:5495] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec reported cstate change: term changed from 0 to 1, leader changed from <none> to f94026d208c74ef194220ac4823c16ec (127.16.45.65). New cstate: current_term: 1 leader_uuid: "f94026d208c74ef194220ac4823c16ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b055e850a48d4f05bb26c690b6cee190" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "163e0b2e75ac482a9a2a305b36a304de" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 43257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f94026d208c74ef194220ac4823c16ec" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 46657 } health_report { overall_health: HEALTHY } } }
I20260806 10:42:24.136004 552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.131203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33640 (local address 127.16.45.65:46657)
0806 10:42:24.131379 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:24.131385 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:24.131403 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:42:24.131488 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:24.131492 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:24.131565 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:24.131688 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:42:24.132026 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.132768 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.134064 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.134520 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.134614 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.135031 (+ 417us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:42:24.135511 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:42:24.135624 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:24.135720 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 10:42:24.135783 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 10:42:24.143929 32727 raft_consensus.cc:1261] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190 [term 1 FOLLOWER]: Refusing update from remote peer f94026d208c74ef194220ac4823c16ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:42:24.143929 461 raft_consensus.cc:1261] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de [term 1 FOLLOWER]: Refusing update from remote peer f94026d208c74ef194220ac4823c16ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:42:24.144891 569 consensus_queue.cc:1035] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "163e0b2e75ac482a9a2a305b36a304de" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 43257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:42:24.145227 565 consensus_queue.cc:1035] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b055e850a48d4f05bb26c690b6cee190" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 10:42:24.146409 32598 tablet.cc:2369] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:42:24.155925 576 mvcc.cc:205] Tried to move back new op lower bound from 7315509019204227072 to 7315509019057049600. Current Snapshot: MvccSnapshot[applied={T|T < 7315509019204227072}]
I20260806 10:42:24.156035 579 mvcc.cc:205] Tried to move back new op lower bound from 7315509019204227072 to 7315509019057049600. Current Snapshot: MvccSnapshot[applied={T|T < 7315509019204227072}]
I20260806 10:42:24.174484 32303 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:42:24.174849 32303 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:42:24.178860 32303 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f5fd27ca751547d19ee76577dbb85449: Sending DeleteTablet for 3 replicas of tablet 31447ba8ae704827956e235f3d0f43cb
I20260806 10:42:24.180156 32700 tablet_service.cc:1514] Processing DeleteTablet for tablet 31447ba8ae704827956e235f3d0f43cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:42:24 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:34418
I20260806 10:42:24.180151 427 tablet_service.cc:1514] Processing DeleteTablet for tablet 31447ba8ae704827956e235f3d0f43cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:42:24 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:49980
I20260806 10:42:24.180549 32495 tablet_service.cc:1514] Processing DeleteTablet for tablet 31447ba8ae704827956e235f3d0f43cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:42:24 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:33630
I20260806 10:42:24.182819 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 32400
I20260806 10:42:24.191097 596 tablet_replica.cc:330] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec: stopping tablet replica
I20260806 10:42:24.192457 596 raft_consensus.cc:2229] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:42:24.194068 596 raft_consensus.cc:2258] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:42:24.194958 594 tablet_replica.cc:330] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190: stopping tablet replica
I20260806 10:42:24.195756 595 tablet_replica.cc:330] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de: stopping tablet replica
I20260806 10:42:24.195963 594 raft_consensus.cc:2229] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:42:24.196189 595 raft_consensus.cc:2229] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:42:24.196568 594 raft_consensus.cc:2258] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:42:24.196660 595 raft_consensus.cc:2258] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:42:24.197199 596 ts_tablet_manager.cc:1905] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:42:24.199018 594 ts_tablet_manager.cc:1905] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:42:24.199018 595 ts_tablet_manager.cc:1905] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:42:24.206149 596 ts_tablet_manager.cc:1918] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:42:24.206466 596 log.cc:1196] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/31447ba8ae704827956e235f3d0f43cb
I20260806 10:42:24.207176 596 ts_tablet_manager.cc:1939] T 31447ba8ae704827956e235f3d0f43cb P f94026d208c74ef194220ac4823c16ec: Deleting consensus metadata
I20260806 10:42:24.207594 594 ts_tablet_manager.cc:1918] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:42:24.207844 594 log.cc:1196] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/31447ba8ae704827956e235f3d0f43cb
I20260806 10:42:24.208475 594 ts_tablet_manager.cc:1939] T 31447ba8ae704827956e235f3d0f43cb P b055e850a48d4f05bb26c690b6cee190: Deleting consensus metadata
I20260806 10:42:24.209507 32278 catalog_manager.cc:4841] TS f94026d208c74ef194220ac4823c16ec (127.16.45.65:46657): tablet 31447ba8ae704827956e235f3d0f43cb (table test-table [id=7eeeb6c57498412dac6587150020f93f]) successfully deleted
I20260806 10:42:24.210464 32286 catalog_manager.cc:4841] TS b055e850a48d4f05bb26c690b6cee190 (127.16.45.66:46457): tablet 31447ba8ae704827956e235f3d0f43cb (table test-table [id=7eeeb6c57498412dac6587150020f93f]) successfully deleted
Aug 06 10:42:24 dist-test-slave-fgb3 krb5kdc[32239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:42:24.212276 595 ts_tablet_manager.cc:1918] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:42:24.212499 595 log.cc:1196] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/31447ba8ae704827956e235f3d0f43cb
I20260806 10:42:24.213090 595 ts_tablet_manager.cc:1939] T 31447ba8ae704827956e235f3d0f43cb P 163e0b2e75ac482a9a2a305b36a304de: Deleting consensus metadata
I20260806 10:42:24.215085 32277 catalog_manager.cc:4841] TS 163e0b2e75ac482a9a2a305b36a304de (127.16.45.67:43257): tablet 31447ba8ae704827956e235f3d0f43cb (table test-table [id=7eeeb6c57498412dac6587150020f93f]) successfully deleted
I20260806 10:42:24.219202 552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.184352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33648 (local address 127.16.45.65:46657)
0806 10:42:24.184538 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:24.184548 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:24.196778 (+ 12230us) server_negotiation.cc:407] Connection header received
0806 10:42:24.197305 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:24.197310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:24.197407 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:24.197517 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:24.204062 (+ 6545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.205287 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.207275 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.207936 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.208041 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.213204 (+ 5163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:24.213223 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:24.213243 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:42:24.213287 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:24.216331 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:24.217045 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:24.217053 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:24.217055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:24.217211 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:24.217602 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:24.217606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:24.217608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:24.218007 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:24.218282 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:24.218646 (+ 364us) server_negotiation.cc:299] Negotiation successful
0806 10:42:24.218883 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:42:24.219874 32585 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:24.329263 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 32400
I20260806 10:42:24.352245 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 32605
Aug 06 10:42:24 dist-test-slave-fgb3 krb5kdc[32239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:42:24.367058 548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.353135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34434 (local address 127.16.45.66:46457)
0806 10:42:24.353335 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:24.353340 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:24.353359 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:42:24.353449 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:24.353453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:24.353516 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:24.353600 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:24.354847 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.355643 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.356844 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.357249 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.357349 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.361561 (+ 4212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:24.361575 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:24.361591 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:42:24.361625 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:24.364468 (+ 2843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:24.365100 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:24.365107 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:24.365110 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:24.365228 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:24.365623 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:24.365626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:24.365628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:24.366024 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:24.366245 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:24.366559 (+ 314us) server_negotiation.cc:299] Negotiation successful
0806 10:42:24.366724 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 10:42:24.367762 320 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:24.456693 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 32605
I20260806 10:42:24.477959 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 335
Aug 06 10:42:24 dist-test-slave-fgb3 krb5kdc[32239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:42:24.492198 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:42:24.478774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49990 (local address 127.16.45.67:43257)
0806 10:42:24.478961 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 10:42:24.478966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:42:24.478985 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:42:24.479087 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:42:24.479091 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:42:24.479166 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:42:24.479249 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:42:24.480514 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.481244 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.482662 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:42:24.483100 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:42:24.483191 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:42:24.487344 (+ 4153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:42:24.487361 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:42:24.487377 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:42:24.487411 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:42:24.489887 (+ 2476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:24.490485 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:24.490492 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:24.490494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:24.490643 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:42:24.490982 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:42:24.490985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:42:24.490987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:42:24.491325 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:42:24.491536 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0806 10:42:24.491777 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 10:42:24.491960 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 10:42:24.492838 515 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:24.581512 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 335
I20260806 10:42:24.602178 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 32256
I20260806 10:42:24.603434 32351 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:42:24.712460 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 32256
2026-08-06T10:42:24Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4336 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:42:24 dist-test-slave-fgb3 krb5kdc[613](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:42:24 dist-test-slave-fgb3 krb5kdc[613](info): set up 2 sockets
Aug 06 10:42:24 dist-test-slave-fgb3 krb5kdc[613](info): commencing operation
krb5kdc: starting...
W20260806 10:42:25.925918 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.009s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:42:26 dist-test-slave-fgb3 krb5kdc[613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012946, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:42:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:42:26Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.16.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.16.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/rangeradmin_127.16.45.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/rangeradmin_127.16.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.16.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.16.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/rangerlookup_127.16.45.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/rangerlookup_127.16.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.16.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.16.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/HTTP_127.16.45.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/HTTP_127.16.45.84@KRBTEST.COM.keytab.
I20260806 10:42:26.318115 16565 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskYt67r8/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/postgres -l logfile start
2026-08-06 10:42:28.901 UTC [660] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 10:42:28.901 UTC [660] LOG: listening on IPv4 address "127.16.45.84", port 56753
2026-08-06 10:42:28.905 UTC [660] LOG: listening on Unix socket "/tmp/.s.PGSQL.56753"
2026-08-06 10:42:28.926 UTC [664] LOG: database system was shut down at 2026-08-06 10:42:27 UTC
2026-08-06 10:42:28.930 UTC [660] LOG: database system is ready to accept connections
I20260806 10:42:29.985812 16565 mini_postgres.cc:96] Postgres bound to 56753
2026-08-06 10:42:30.010 UTC [676] FATAL: database "slave" does not exist
127.16.45.84:56753 - accepting connections
I20260806 10:42:30.011508 16565 mini_ranger.cc:161] Starting Ranger...
I20260806 10:42:30.044226 16565 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 10:42:30.527249 16565 mini_ranger.cc:87] Created ranger Postgres database
I20260806 10:42:30.527372 16565 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-admin
2026-08-06 10:42:30,879 [I] DB FLAVOR :POSTGRES
2026-08-06 10:42:30,880 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 10:42:30,880 [I] Checking connection..
2026-08-06 10:42:30,880 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 10:42:31,153 [I] Checking connection passed.
2026-08-06 10:42:31,153 [I] --------- Verifying version history table ---------
2026-08-06 10:42:31,154 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 10:42:31,414 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 10:42:31,414 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 10:42:31,677 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 10:42:31,677 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 10:42:31,677 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 10:42:31.910 UTC [772] WARNING: there is no transaction in progress
2026-08-06 10:42:31,918 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 10:42:31,919 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 10:42:32,183 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 10:42:32,184 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 10:42:32,184 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 10:42:32,422 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 10:42:32,681 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-fgb3.c.gcp-upstream.internal','N') ;"
2026-08-06 10:42:32,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 10:42:33,173 [I] Table x_portal_user does not exist in database ranger
2026-08-06 10:42:33,174 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 10:42:33,427 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 10:42:33,427 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 10:42:33,668 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 10:42:33,925 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 10:42:33,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 10:42:34.902 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:34.918 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:34.933 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:34.948 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:34.964 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:34.982 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:35.050 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:35.058 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:35.073 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:35.084 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:35.095 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:35.110 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:35.120 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:35.127 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:35.134 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:35.141 UTC [936] WARNING: there is no transaction in progress
2026-08-06 10:42:35,810 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 10:42:35,810 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 10:42:36,041 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 10:42:36,041 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 10:42:36,282 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 10:42:36,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 10:42:36,548 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 10:42:36,548 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 10:42:36,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 10:42:37,056 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-fgb3.c.gcp-upstream.internal';"
2026-08-06 10:42:37,292 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 10:42:37,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 10:42:37,549 [I] DB_PATCHES have already been applied
I20260806 10:42:37.555876 16565 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-admin:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskYt67r8/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 10:42:37.555974 16565 mini_ranger.cc:193] Using host: 127.16.45.84
I20260806 10:42:37.576287 16565 mini_ranger.cc:227] Ranger admin URL: http://127.16.45.84:47495
Aug 06, 2026 10:42:37 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 10:42:37 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 10:42:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 10:42:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 10:42:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 10:42:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 10:42:38 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 10:42:38.816705 16565 mini_ranger.cc:160] Time spent starting Ranger: real 8.805s user 0.006s sys 0.060s
Aug 06, 2026 10:42:59 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 10:42:59 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 06, 2026 10:42:59 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 10:42:59 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 10:42:59 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 10:43:00 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 10:43:00.667896 16565 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.16.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.16.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/rangerkms_127.16.45.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/rangerkms_127.16.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.16.45.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.16.45.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.16.45.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/HTTP_127.16.45.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.16.45.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/HTTP_127.16.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 10:43:00 dist-test-slave-fgb3 krb5kdc[613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012980, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 10:43:00.862826 16565 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 10:43:00.889483 16565 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 10:43:01.793061 16565 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 10:43:01.793229 16565 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-kms
I20260806 10:43:01.793378 16565 mini_ranger_kms.cc:227] Using postgres at 127.16.45.84:56753
2026-08-06 10:43:02,311 [I] DB FLAVOR :POSTGRES
2026-08-06 10:43:02,311 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 10:43:02,311 [I] Checking connection
2026-08-06 10:43:02,311 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 10:43:02,563 [I] connection success
2026-08-06 10:43:02,563 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 10:43:02,563 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 10:43:02,564 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 10:43:02,800 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 10:43:02,800 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 10:43:02,801 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 10:43:02,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:56753/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 10:43:03,068 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 10:43:03.511920 16565 mini_ranger_kms.cc:310] Created kms service
I20260806 10:43:03.713212 16565 mini_ranger_kms.cc:326] Created kudu user
I20260806 10:43:03.756580 16565 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 10:43:03 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012980, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:43:04.190012 16565 mini_ranger_kms.cc:384] Added ranger policy
I20260806 10:43:04.191478 16565 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-kms:/tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 10:43:04.191545 16565 mini_ranger_kms.cc:240] Using host: 127.16.45.84
I20260806 10:43:04.223441 16565 mini_ranger_kms.cc:276] Ranger KMS PID: 1207
I20260806 10:43:04.223634 16565 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.16.45.84:41315
Aug 06, 2026 10:43:05 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 10:43:05 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 10:43:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 10:43:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 10:43:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 10:43:05 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 10:43:06 dist-test-slave-fgb3 krb5kdc[613](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786012986, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.45.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:43:06.752719 16565 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.890s user 0.148s sys 0.374s
I20260806 10:43:06.753054 16565 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 10:43:06.753273 16565 mini_ranger_kms.cc:401] 127.16.45.84:41315/kms/v1/keys
Aug 06 10:43:07 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012986, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.45.84@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
Aug 06 10:43:07 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012986, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.45.84@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
Aug 06 10:43:09 dist-test-slave-fgb3 krb5kdc[613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:43:09.963143 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:42169
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:39395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:42169
--ranger_config_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.45.84:41315/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:43:10.362641 1290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:43:10.362960 1290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:43:10.363085 1290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:43:10.370579 1290 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:43:10.370700 1290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:43:10.370756 1290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:43:10.370834 1290 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:43:10.370890 1290 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:43:10.381469 1290 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:39395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/wal
--ranger_kms_url=127.16.45.84:41315/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:42169
--ranger_config_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:42169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:43:10.382884 1290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:43:10.384222 1290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:43:10.396660 1297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:43:10.396533 1298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:43:10.396566 1300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:43:10.397207 1290 server_base.cc:1034] running on GCE node
I20260806 10:43:10.398029 1290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:43:10.399478 1290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:43:10.400707 1290 hybrid_clock.cc:648] HybridClock initialized: now 1786012990400660 us; error 36 us; skew 500 ppm
I20260806 10:43:10.401036 1290 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:43:10 dist-test-slave-fgb3 krb5kdc[613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012990, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:43:10.404122 1290 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:43:10.405612 1290 webserver.cc:460] Webserver started at http://127.16.45.126:45075/ using document root <none> and password file <none>
I20260806 10:43:10.406266 1290 fs_manager.cc:359] Metadata directory not provided
I20260806 10:43:10.406406 1290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:43:10.406739 1290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 10:43:10 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012990, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:43:10.459576 1290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "24b239874bf3478bb8b130ef4f163b74"
format_stamp: "Formatted at 2026-08-06 10:43:10 on dist-test-slave-fgb3"
server_key: "d21ea8756a97aef21fc2f701c73b7ab0"
server_key_iv: "3ba6e21b2cd8b2e1a9a258b8df585f66"
server_key_version: "kuduclusterkey@0"
I20260806 10:43:10.460556 1290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "24b239874bf3478bb8b130ef4f163b74"
format_stamp: "Formatted at 2026-08-06 10:43:10 on dist-test-slave-fgb3"
server_key: "d21ea8756a97aef21fc2f701c73b7ab0"
server_key_iv: "3ba6e21b2cd8b2e1a9a258b8df585f66"
server_key_version: "kuduclusterkey@0"
I20260806 10:43:10.466180 1290 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260806 10:43:10.487704 1310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:43:10.489342 1290 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 10:43:10.489535 1290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "24b239874bf3478bb8b130ef4f163b74"
format_stamp: "Formatted at 2026-08-06 10:43:10 on dist-test-slave-fgb3"
server_key: "d21ea8756a97aef21fc2f701c73b7ab0"
server_key_iv: "3ba6e21b2cd8b2e1a9a258b8df585f66"
server_key_version: "kuduclusterkey@0"
I20260806 10:43:10.489782 1290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:43:10.511613 1290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:43:10.516152 1290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:43:10.516497 1290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:43:10.536713 1290 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:42169
I20260806 10:43:10.536731 1384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:42169 every 8 connection(s)
I20260806 10:43:10.538188 1290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:43:10.539021 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 1290
I20260806 10:43:10.539252 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:43:10.540279 16565 external_mini_cluster.cc:1428] Setting key f834825f40bd84d835e8dd2bed11509a
I20260806 10:43:10.548456 1387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 10:43:10 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:43:10.559271 1387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74: Bootstrap starting.
I20260806 10:43:10.562743 1387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74: Neither blocks nor log segments found. Creating new log.
I20260806 10:43:10.563747 1387 log.cc:824] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74: Log is configured to *not* fsync() on all Append() calls
I20260806 10:43:10.566711 1390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:10.542644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39278 (local address 127.16.45.126:42169)
0806 10:43:10.547267 (+ 4623us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:10.547281 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:10.547334 (+ 53us) server_negotiation.cc:407] Connection header received
0806 10:43:10.549235 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:10.549260 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:10.549652 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:10.550047 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:43:10.551558 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:10.553038 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:10.554438 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:10.555145 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:10.555344 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:10.559506 (+ 4162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:43:10.559516 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:43:10.559532 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:43:10.559572 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:43:10.562644 (+ 3072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:10.563359 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:10.563366 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:10.563373 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:10.563538 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:10.563916 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:10.563921 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:10.563924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:10.564627 (+ 703us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:43:10.564939 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:10.565332 (+ 393us) server_negotiation.cc:299] Negotiation successful
0806 10:43:10.565666 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4282,"thread_start_us":4025,"threads_started":1}
I20260806 10:43:10.567057 1387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74: No bootstrap required, opened a new log
I20260806 10:43:10.575384 1387 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24b239874bf3478bb8b130ef4f163b74" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42169 } }
I20260806 10:43:10.575766 1387 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:43:10.575875 1387 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24b239874bf3478bb8b130ef4f163b74, State: Initialized, Role: FOLLOWER
I20260806 10:43:10.576437 1387 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24b239874bf3478bb8b130ef4f163b74" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42169 } }
I20260806 10:43:10.576669 1387 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:43:10.576813 1387 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:43:10.576987 1387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:43:10.579509 1387 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24b239874bf3478bb8b130ef4f163b74" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42169 } }
I20260806 10:43:10.580016 1387 leader_election.cc:302] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24b239874bf3478bb8b130ef4f163b74; no voters:
I20260806 10:43:10.580680 1387 leader_election.cc:288] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:43:10.580816 1392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:43:10.581511 1392 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [term 1 LEADER]: Becoming Leader. State: Replica: 24b239874bf3478bb8b130ef4f163b74, State: Running, Role: LEADER
I20260806 10:43:10.582041 1392 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24b239874bf3478bb8b130ef4f163b74" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42169 } }
I20260806 10:43:10.582978 1387 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:43:10.584947 1394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24b239874bf3478bb8b130ef4f163b74. Latest consensus state: current_term: 1 leader_uuid: "24b239874bf3478bb8b130ef4f163b74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24b239874bf3478bb8b130ef4f163b74" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42169 } } }
I20260806 10:43:10.585335 1394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [sys.catalog]: This master's current role is: LEADER
I20260806 10:43:10.584921 1393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24b239874bf3478bb8b130ef4f163b74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24b239874bf3478bb8b130ef4f163b74" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 42169 } } }
I20260806 10:43:10.585537 1393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74 [sys.catalog]: This master's current role is: LEADER
I20260806 10:43:10.591523 1398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:43:10.597091 1398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:43:10.598009 1387 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 10:43:10.614982 1398 catalog_manager.cc:1347] Generated new cluster ID: f15bc26621424ad987e947098967ba6f
I20260806 10:43:10.615149 1398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:43:10.631032 1398 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:43:10.632449 1398 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:43:10.641466 1398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74: Generated new TSK 0
I20260806 10:43:10.642354 1398 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:43:11.519660 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.45.84:41315/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42169
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:39395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 10:43:11 dist-test-slave-fgb3 krb5kdc[613](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786012991, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 10:43:12.157388 1455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:43:12.157829 1455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:43:12.158059 1455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:43:12.167526 1455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:43:12.167778 1455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:43:12.168069 1455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:43:12.182160 1455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:39395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.16.45.84:41315/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:43:12.183911 1455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:43:12.185585 1455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:43:12.203670 1469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:43:12.204185 1472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:43:12.204743 1475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:43:12.206522 1455 server_base.cc:1034] running on GCE node
I20260806 10:43:12.207469 1455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:43:12.209076 1455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:43:12.210486 1455 hybrid_clock.cc:648] HybridClock initialized: now 1786012992210295 us; error 103 us; skew 500 ppm
I20260806 10:43:12.210986 1455 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:43:12 dist-test-slave-fgb3 krb5kdc[613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012992, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:43:12.216334 1455 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:43:12.226471 1455 webserver.cc:460] Webserver started at http://127.16.45.65:33187/ using document root <none> and password file <none>
I20260806 10:43:12.227576 1455 fs_manager.cc:359] Metadata directory not provided
I20260806 10:43:12.227823 1455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:43:12.228256 1455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 10:43:12 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012992, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:43:12.250957 1455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "3773565a6cca4ee39b500d5a57ba6135"
format_stamp: "Formatted at 2026-08-06 10:43:12 on dist-test-slave-fgb3"
server_key: "67f98ab5e6faf0b0179325f5f808ac7e"
server_key_iv: "ea6625d39ffe6b79f5177b7050dcb733"
server_key_version: "kuduclusterkey@0"
I20260806 10:43:12.252924 1455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "3773565a6cca4ee39b500d5a57ba6135"
format_stamp: "Formatted at 2026-08-06 10:43:12 on dist-test-slave-fgb3"
server_key: "67f98ab5e6faf0b0179325f5f808ac7e"
server_key_iv: "ea6625d39ffe6b79f5177b7050dcb733"
server_key_version: "kuduclusterkey@0"
I20260806 10:43:12.263084 1455 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.008s sys 0.000s
I20260806 10:43:12.298640 1487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:43:12.301173 1455 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.004s sys 0.007s
I20260806 10:43:12.301560 1455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "3773565a6cca4ee39b500d5a57ba6135"
format_stamp: "Formatted at 2026-08-06 10:43:12 on dist-test-slave-fgb3"
server_key: "67f98ab5e6faf0b0179325f5f808ac7e"
server_key_iv: "ea6625d39ffe6b79f5177b7050dcb733"
server_key_version: "kuduclusterkey@0"
I20260806 10:43:12.301973 1455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:43:12.335273 1455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:43:12.340965 1455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:43:12.341617 1455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:43:12.343518 1455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:43:12.346002 1455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:43:12.346091 1455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:43:12.346252 1455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:43:12.346390 1455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 10:43:12 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012991, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:43:12.525141 1455 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:38299
I20260806 10:43:12.525256 1653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:38299 every 8 connection(s)
I20260806 10:43:12.527396 1455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:43:12.536749 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 1455
I20260806 10:43:12.537010 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:43:12.538107 16565 external_mini_cluster.cc:1428] Setting key 4dd3a09fccd0da9a3db90fdfd2228654
Aug 06 10:43:12 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012992, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:43:12.575017 1658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:12.531537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:32829 (local address 127.16.45.126:42169)
0806 10:43:12.555707 (+ 24170us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:12.555715 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:12.555743 (+ 28us) server_negotiation.cc:407] Connection header received
0806 10:43:12.555816 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:12.555821 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:12.555909 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:12.556052 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:43:12.558599 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:12.560067 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:12.561790 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:12.562723 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:12.562863 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:12.566732 (+ 3869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:43:12.566748 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:43:12.566751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:43:12.566789 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:43:12.570855 (+ 4066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:12.571880 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:12.571884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:12.571887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:12.572114 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:12.572704 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:12.572708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:12.572710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:12.573100 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:43:12.573234 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:12.574178 (+ 944us) server_negotiation.cc:299] Negotiation successful
0806 10:43:12.574472 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24015,"thread_start_us":23871,"threads_started":1}
I20260806 10:43:12.576700 1659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:12.532335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42169 (local address 127.16.45.65:32829)
0806 10:43:12.538297 (+ 5962us) negotiation.cc:107] Waiting for socket to connect
0806 10:43:12.538387 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0806 10:43:12.546266 (+ 7879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:43:12.556570 (+ 10304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:43:12.556588 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:43:12.557616 (+ 1028us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:43:12.558373 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:12.558406 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:12.560259 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:12.560264 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:12.561602 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:12.561618 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:12.562973 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:12.562979 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:12.563198 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:12.563908 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:43:12.563933 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:43:12.566417 (+ 2484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:43:12.571027 (+ 4610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:43:12.571037 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:43:12.571056 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:43:12.571731 (+ 675us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:43:12.572260 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:43:12.572263 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:43:12.572266 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:43:12.572571 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:43:12.573264 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:43:12.573285 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:43:12.573726 (+ 441us) client_negotiation.cc:769] Sending connection context
0806 10:43:12.574050 (+ 324us) client_negotiation.cc:240] Negotiation successful
0806 10:43:12.574812 (+ 762us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5454,"thread_start_us":6643,"threads_started":1}
I20260806 10:43:12.578666 1654 heartbeater.cc:347] Connected to a master server at 127.16.45.126:42169
I20260806 10:43:12.579054 1654 heartbeater.cc:464] Registering TS with master...
I20260806 10:43:12.580092 1654 heartbeater.cc:511] Master 127.16.45.126:42169 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
I20260806 10:43:12.582679 1333 ts_manager.cc:194] Registered new tserver with Master: 3773565a6cca4ee39b500d5a57ba6135 (127.16.45.65:38299)
I20260806 10:43:12.584858 1333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:32829
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:43:12.623170 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.45.84:41315/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42169
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:39395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 10:43:12 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012991, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
W20260806 10:43:13.275828 1662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:43:13.276240 1662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:43:13.276450 1662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:43:13.286648 1662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:43:13.286845 1662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:43:13.287096 1662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:43:13.301962 1662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:39395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.16.45.84:41315/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:43:13.303618 1662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:43:13.305264 1662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:43:13.336366 1687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:43:13.336589 1686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:43:13.337033 1691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:43:13.339828 1662 server_base.cc:1034] running on GCE node
I20260806 10:43:13.340549 1662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:43:13.341603 1662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:43:13.342829 1662 hybrid_clock.cc:648] HybridClock initialized: now 1786012993342768 us; error 56 us; skew 500 ppm
I20260806 10:43:13.343153 1662 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:43:13 dist-test-slave-fgb3 krb5kdc[613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012993, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:43:13.348034 1662 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:43:13.350690 1662 webserver.cc:460] Webserver started at http://127.16.45.66:34329/ using document root <none> and password file <none>
I20260806 10:43:13.351676 1662 fs_manager.cc:359] Metadata directory not provided
I20260806 10:43:13.351900 1662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:43:13.352345 1662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 10:43:13 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012993, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:43:13.373442 1662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "b82b6c94c32b400d8e5c1b5bff612cc9"
format_stamp: "Formatted at 2026-08-06 10:43:13 on dist-test-slave-fgb3"
server_key: "34d9e7d3582c264f3d5ff782dcee7615"
server_key_iv: "117f9875c58129a7dcb9c53ea98c3565"
server_key_version: "kuduclusterkey@0"
I20260806 10:43:13.374665 1662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "b82b6c94c32b400d8e5c1b5bff612cc9"
format_stamp: "Formatted at 2026-08-06 10:43:13 on dist-test-slave-fgb3"
server_key: "34d9e7d3582c264f3d5ff782dcee7615"
server_key_iv: "117f9875c58129a7dcb9c53ea98c3565"
server_key_version: "kuduclusterkey@0"
I20260806 10:43:13.382373 1662 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.005s
I20260806 10:43:13.401124 1700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:43:13.402982 1662 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 10:43:13.403272 1662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "b82b6c94c32b400d8e5c1b5bff612cc9"
format_stamp: "Formatted at 2026-08-06 10:43:13 on dist-test-slave-fgb3"
server_key: "34d9e7d3582c264f3d5ff782dcee7615"
server_key_iv: "117f9875c58129a7dcb9c53ea98c3565"
server_key_version: "kuduclusterkey@0"
I20260806 10:43:13.403656 1662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:43:13.442869 1662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:43:13.447862 1662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:43:13.448172 1662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:43:13.449335 1662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:43:13.450968 1662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:43:13.451052 1662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:43:13.451223 1662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:43:13.451292 1662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:43:13.507404 1662 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:38095
I20260806 10:43:13.507517 1854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:38095 every 8 connection(s)
I20260806 10:43:13.509192 1662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:43:13.516111 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 1662
I20260806 10:43:13.516310 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:43:13.516973 16565 external_mini_cluster.cc:1428] Setting key 1ef3cdf972060c651775dda8f6c45c3f
Aug 06 10:43:13 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012993, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:43:13.540364 1857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:13.512914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:57925 (local address 127.16.45.126:42169)
0806 10:43:13.513758 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:13.513764 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:13.515187 (+ 1423us) server_negotiation.cc:407] Connection header received
0806 10:43:13.518481 (+ 3294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:13.518486 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:13.518547 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:13.518636 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:43:13.521316 (+ 2680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:13.522480 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:13.525740 (+ 3260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:13.526637 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:13.526767 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:13.532209 (+ 5442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:43:13.532216 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:43:13.532221 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:43:13.532309 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:43:13.536082 (+ 3773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:13.537119 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:13.537125 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:13.537128 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:13.537362 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:13.537986 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:13.537991 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:13.537995 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:13.538514 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:43:13.538653 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:13.539556 (+ 903us) server_negotiation.cc:299] Negotiation successful
0806 10:43:13.539773 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":500,"threads_started":1}
I20260806 10:43:13.541700 1858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:13.513624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42169 (local address 127.16.45.66:57925)
0806 10:43:13.515012 (+ 1388us) negotiation.cc:107] Waiting for socket to connect
0806 10:43:13.515060 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 10:43:13.518172 (+ 3112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:43:13.519020 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:43:13.519033 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:43:13.519897 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:43:13.521134 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:13.521160 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:13.522688 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:13.522694 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:13.525544 (+ 2850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:13.525591 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:13.526991 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:13.526999 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:13.527365 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:13.528378 (+ 1013us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:43:13.528408 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:43:13.531965 (+ 3557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:43:13.536237 (+ 4272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:43:13.536246 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:43:13.536261 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:43:13.536982 (+ 721us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:43:13.537514 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:43:13.537518 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:43:13.537522 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:43:13.537859 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:43:13.538705 (+ 846us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:43:13.538713 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:43:13.539104 (+ 391us) client_negotiation.cc:769] Sending connection context
0806 10:43:13.539455 (+ 351us) client_negotiation.cc:240] Negotiation successful
0806 10:43:13.540112 (+ 657us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1083,"thread_start_us":706,"threads_started":1}
I20260806 10:43:13.543663 1855 heartbeater.cc:347] Connected to a master server at 127.16.45.126:42169
I20260806 10:43:13.544107 1855 heartbeater.cc:464] Registering TS with master...
I20260806 10:43:13.545302 1855 heartbeater.cc:511] Master 127.16.45.126:42169 requested a full tablet report, sending...
I20260806 10:43:13.547672 1333 ts_manager.cc:194] Registered new tserver with Master: b82b6c94c32b400d8e5c1b5bff612cc9 (127.16.45.66:38095)
I20260806 10:43:13.549170 1333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:57925
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:43:13.586069 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.45.84:41315/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42169
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:39395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:43:13.589295 1654 heartbeater.cc:503] Master 127.16.45.126:42169 was elected leader, sending a full tablet report...
W20260806 10:43:14.144838 1862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:43:14.145166 1862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:43:14.145291 1862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:43:14.156265 1862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:43:14.156445 1862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:43:14.156646 1862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:43:14.169862 1862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:39395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.16.45.84:41315/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:42169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:43:14.171424 1862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:43:14.172986 1862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:43:14.191717 1872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:43:14.191701 1873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:43:14.192240 1878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:43:14.193627 1862 server_base.cc:1034] running on GCE node
I20260806 10:43:14.194540 1862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:43:14.195732 1862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:43:14.196962 1862 hybrid_clock.cc:648] HybridClock initialized: now 1786012994196913 us; error 39 us; skew 500 ppm
I20260806 10:43:14.197302 1862 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:43:14 dist-test-slave-fgb3 krb5kdc[613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012994, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:43:14.203859 1862 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:43:14.205714 1862 webserver.cc:460] Webserver started at http://127.16.45.67:41805/ using document root <none> and password file <none>
I20260806 10:43:14.206585 1862 fs_manager.cc:359] Metadata directory not provided
I20260806 10:43:14.206760 1862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:43:14.207098 1862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 10:43:14 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012994, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:43:14.225031 1862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "d2da97bb54344c7781daa60a1945970b"
format_stamp: "Formatted at 2026-08-06 10:43:14 on dist-test-slave-fgb3"
server_key: "7ef5231152ccca8a7379196eecb8d368"
server_key_iv: "128cfd3d480d99394b3285a090ec4ec5"
server_key_version: "kuduclusterkey@0"
I20260806 10:43:14.226140 1862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "d2da97bb54344c7781daa60a1945970b"
format_stamp: "Formatted at 2026-08-06 10:43:14 on dist-test-slave-fgb3"
server_key: "7ef5231152ccca8a7379196eecb8d368"
server_key_iv: "128cfd3d480d99394b3285a090ec4ec5"
server_key_version: "kuduclusterkey@0"
I20260806 10:43:14.233155 1862 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260806 10:43:14.253638 1887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:43:14.255302 1862 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 10:43:14.255491 1862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "d2da97bb54344c7781daa60a1945970b"
format_stamp: "Formatted at 2026-08-06 10:43:14 on dist-test-slave-fgb3"
server_key: "7ef5231152ccca8a7379196eecb8d368"
server_key_iv: "128cfd3d480d99394b3285a090ec4ec5"
server_key_version: "kuduclusterkey@0"
I20260806 10:43:14.255720 1862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:43:14.284363 1862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:43:14.289284 1862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:43:14.289705 1862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:43:14.291141 1862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:43:14.293650 1862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:43:14.293804 1862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:43:14.293990 1862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:43:14.294057 1862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:43:14.353922 1862 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:45495
I20260806 10:43:14.354125 2043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:45495 every 8 connection(s)
I20260806 10:43:14.355857 1862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:43:14.359869 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 1862
I20260806 10:43:14.360098 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:43:14.360677 16565 external_mini_cluster.cc:1428] Setting key 54df093b78e6e0a059533344c692f942
Aug 06 10:43:14 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012994, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:43:14.384509 2051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.359667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:57861 (local address 127.16.45.126:42169)
0806 10:43:14.360622 (+ 955us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:14.360632 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:14.362440 (+ 1808us) server_negotiation.cc:407] Connection header received
0806 10:43:14.365869 (+ 3429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:14.365873 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:14.365983 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:14.366080 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:43:14.368329 (+ 2249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.369508 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.371781 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.372599 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.372707 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.377103 (+ 4396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:43:14.377110 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:43:14.377115 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:43:14.377153 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:43:14.380638 (+ 3485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:14.381586 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:14.381590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:14.381592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:14.381815 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:14.382450 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:14.382453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:14.382456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:14.382891 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:43:14.383099 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:14.383803 (+ 704us) server_negotiation.cc:299] Negotiation successful
0806 10:43:14.384031 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":811,"thread_start_us":588,"threads_started":1}
I20260806 10:43:14.385506 2052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.360373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:42169 (local address 127.16.45.67:57861)
0806 10:43:14.362196 (+ 1823us) negotiation.cc:107] Waiting for socket to connect
0806 10:43:14.362276 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 10:43:14.365564 (+ 3288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:43:14.366473 (+ 909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:43:14.366483 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:43:14.367150 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:43:14.368133 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.368155 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.369678 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.369683 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.371559 (+ 1876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.371614 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.372899 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.372905 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.373229 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.373997 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:43:14.374021 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:43:14.376807 (+ 2786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:43:14.380786 (+ 3979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:43:14.380793 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:43:14.380808 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:43:14.381384 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:43:14.381987 (+ 603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:43:14.381993 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:43:14.381996 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:43:14.382306 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:43:14.383041 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:43:14.383049 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:43:14.383379 (+ 330us) client_negotiation.cc:769] Sending connection context
0806 10:43:14.383671 (+ 292us) client_negotiation.cc:240] Negotiation successful
0806 10:43:14.384263 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1420,"thread_start_us":999,"threads_started":1}
I20260806 10:43:14.387151 2044 heartbeater.cc:347] Connected to a master server at 127.16.45.126:42169
I20260806 10:43:14.387494 2044 heartbeater.cc:464] Registering TS with master...
I20260806 10:43:14.388479 2044 heartbeater.cc:511] Master 127.16.45.126:42169 requested a full tablet report, sending...
I20260806 10:43:14.389978 1333 ts_manager.cc:194] Registered new tserver with Master: d2da97bb54344c7781daa60a1945970b (127.16.45.67:45495)
I20260806 10:43:14.390830 1333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:57861
I20260806 10:43:14.402403 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:43:14.425292 2051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.408671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47048 (local address 127.16.45.126:42169)
0806 10:43:14.408884 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:14.408892 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:14.409390 (+ 498us) server_negotiation.cc:407] Connection header received
0806 10:43:14.409692 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:14.409697 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:14.409810 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:14.409912 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:43:14.412089 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.412903 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.414797 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.415398 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.415535 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.418662 (+ 3127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:43:14.418668 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:43:14.418672 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:43:14.418709 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:43:14.422120 (+ 3411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:14.423043 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:14.423047 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:14.423049 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:14.423215 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:14.423685 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:14.423688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:14.423691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:14.424072 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:43:14.424345 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:14.424765 (+ 420us) server_negotiation.cc:299] Negotiation successful
0806 10:43:14.424985 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 10:43:14.429678 1333 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47048:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:43:14.440807 1333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:43:14.473644 2069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.457804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:38095 (local address 127.0.0.1:58036)
0806 10:43:14.459742 (+ 1938us) negotiation.cc:107] Waiting for socket to connect
0806 10:43:14.459795 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 10:43:14.459968 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:43:14.461452 (+ 1484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:43:14.461459 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:43:14.461532 (+ 73us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:43:14.462504 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.462521 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.465094 (+ 2573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.465099 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.469073 (+ 3974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.469089 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.471916 (+ 2827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.471925 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.472313 (+ 388us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.472375 (+ 62us) client_negotiation.cc:769] Sending connection context
0806 10:43:14.472508 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 10:43:14.472742 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1662,"mutex_wait_us":72,"thread_start_us":3597,"threads_started":1}
I20260806 10:43:14.474702 2068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.458126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58036 (local address 127.16.45.66:38095)
0806 10:43:14.460720 (+ 2594us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:14.460729 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:14.460762 (+ 33us) server_negotiation.cc:407] Connection header received
0806 10:43:14.460874 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:14.460883 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:14.461184 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:14.461428 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:43:14.462736 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.464910 (+ 2174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.469300 (+ 4390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.471576 (+ 2276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.471733 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.471990 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:14.473923 (+ 1933us) server_negotiation.cc:299] Negotiation successful
0806 10:43:14.474119 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2429,"thread_start_us":2612,"threads_started":1}
I20260806 10:43:14.476425 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.462748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48818 (local address 127.16.45.65:38299)
0806 10:43:14.464660 (+ 1912us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:14.464669 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:14.464695 (+ 26us) server_negotiation.cc:407] Connection header received
0806 10:43:14.464787 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:14.464793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:14.465011 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:14.465286 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:43:14.466812 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.469010 (+ 2198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.472478 (+ 3468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.474842 (+ 2364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.475026 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.475338 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:14.475649 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 10:43:14.475877 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1711,"thread_start_us":1449,"threads_started":1}
I20260806 10:43:14.476491 2071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.462000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38299 (local address 127.0.0.1:48818)
0806 10:43:14.463477 (+ 1477us) negotiation.cc:107] Waiting for socket to connect
0806 10:43:14.463495 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:43:14.463627 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:43:14.465268 (+ 1641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:43:14.465274 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:43:14.465298 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:43:14.466632 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.466645 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.469235 (+ 2590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.469241 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.472308 (+ 3067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.472324 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.475189 (+ 2865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.475197 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.475465 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.475489 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 10:43:14.475559 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 10:43:14.475682 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1313,"mutex_wait_us":40,"thread_start_us":1024,"threads_started":1}
I20260806 10:43:14.479074 1765 tablet_service.cc:1467] Processing CreateTablet for tablet d1d384af78ce420fad402ce937d0456b (DEFAULT_TABLE table=test-table [id=e939533365564f45aa218701c0060291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:43:14.480446 2067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.458426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:45495 (local address 127.0.0.1:56360)
0806 10:43:14.462018 (+ 3592us) negotiation.cc:107] Waiting for socket to connect
0806 10:43:14.462060 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 10:43:14.463184 (+ 1124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:43:14.464775 (+ 1591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:43:14.464780 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:43:14.464808 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:43:14.466289 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.466305 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.469592 (+ 3287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.469598 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.476777 (+ 7179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.476791 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.479435 (+ 2644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.479440 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.479650 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.479674 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 10:43:14.479747 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 10:43:14.479870 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3398,"thread_start_us":819,"threads_started":1}
I20260806 10:43:14.480597 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.458988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56360 (local address 127.16.45.67:45495)
0806 10:43:14.461183 (+ 2195us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:14.461191 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:14.462221 (+ 1030us) server_negotiation.cc:407] Connection header received
0806 10:43:14.463910 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:14.463918 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:14.464546 (+ 628us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:14.464763 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:43:14.466877 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.469238 (+ 2361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.476929 (+ 7691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.478765 (+ 1836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.478894 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.479202 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:14.479833 (+ 631us) server_negotiation.cc:299] Negotiation successful
0806 10:43:14.480031 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1926,"thread_start_us":1550,"threads_started":1}
I20260806 10:43:14.481165 1561 tablet_service.cc:1467] Processing CreateTablet for tablet d1d384af78ce420fad402ce937d0456b (DEFAULT_TABLE table=test-table [id=e939533365564f45aa218701c0060291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:43:14.482079 1765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1d384af78ce420fad402ce937d0456b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:43:14.483074 1561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1d384af78ce420fad402ce937d0456b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:43:14.484319 1951 tablet_service.cc:1467] Processing CreateTablet for tablet d1d384af78ce420fad402ce937d0456b (DEFAULT_TABLE table=test-table [id=e939533365564f45aa218701c0060291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:43:14.485986 1951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1d384af78ce420fad402ce937d0456b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:43:14.502229 2076 tablet_bootstrap.cc:492] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135: Bootstrap starting.
I20260806 10:43:14.508450 2074 tablet_bootstrap.cc:492] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b: Bootstrap starting.
I20260806 10:43:14.509917 2075 tablet_bootstrap.cc:492] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9: Bootstrap starting.
I20260806 10:43:14.514940 2075 tablet_bootstrap.cc:654] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9: Neither blocks nor log segments found. Creating new log.
I20260806 10:43:14.516405 2076 tablet_bootstrap.cc:654] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135: Neither blocks nor log segments found. Creating new log.
I20260806 10:43:14.517202 2075 log.cc:824] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9: Log is configured to *not* fsync() on all Append() calls
I20260806 10:43:14.517799 2074 tablet_bootstrap.cc:654] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b: Neither blocks nor log segments found. Creating new log.
I20260806 10:43:14.518760 2076 log.cc:824] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135: Log is configured to *not* fsync() on all Append() calls
I20260806 10:43:14.520342 2074 log.cc:824] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b: Log is configured to *not* fsync() on all Append() calls
I20260806 10:43:14.525633 2075 tablet_bootstrap.cc:492] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9: No bootstrap required, opened a new log
I20260806 10:43:14.526149 2075 ts_tablet_manager.cc:1397] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.010s
I20260806 10:43:14.531005 2074 tablet_bootstrap.cc:492] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b: No bootstrap required, opened a new log
I20260806 10:43:14.531466 2074 ts_tablet_manager.cc:1397] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.012s
I20260806 10:43:14.540992 2075 raft_consensus.cc:348] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38095 } } peers { permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 } } peers { permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 } }
I20260806 10:43:14.541635 2075 raft_consensus.cc:374] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:43:14.541785 2075 raft_consensus.cc:729] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82b6c94c32b400d8e5c1b5bff612cc9, State: Initialized, Role: FOLLOWER
I20260806 10:43:14.541936 2076 tablet_bootstrap.cc:492] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135: No bootstrap required, opened a new log
I20260806 10:43:14.542356 2076 ts_tablet_manager.cc:1397] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135: Time spent bootstrapping tablet: real 0.040s user 0.019s sys 0.008s
I20260806 10:43:14.542640 2075 consensus_queue.cc:260] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38095 } } peers { permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 } } peers { permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 } }
I20260806 10:43:14.544450 2074 raft_consensus.cc:348] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38095 } } peers { permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 } } peers { permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 } }
I20260806 10:43:14.545161 2074 raft_consensus.cc:374] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:43:14.545359 2074 raft_consensus.cc:729] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2da97bb54344c7781daa60a1945970b, State: Initialized, Role: FOLLOWER
I20260806 10:43:14.546406 2074 consensus_queue.cc:260] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38095 } } peers { permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 } } peers { permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 } }
I20260806 10:43:14.552524 1855 heartbeater.cc:503] Master 127.16.45.126:42169 was elected leader, sending a full tablet report...
I20260806 10:43:14.558553 2076 raft_consensus.cc:348] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38095 } } peers { permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 } } peers { permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 } }
I20260806 10:43:14.559229 2076 raft_consensus.cc:374] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:43:14.559432 2076 raft_consensus.cc:729] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3773565a6cca4ee39b500d5a57ba6135, State: Initialized, Role: FOLLOWER
I20260806 10:43:14.560315 2076 consensus_queue.cc:260] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38095 } } peers { permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 } } peers { permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 } }
I20260806 10:43:14.569612 2076 ts_tablet_manager.cc:1428] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135: Time spent starting tablet: real 0.027s user 0.014s sys 0.011s
I20260806 10:43:14.571444 2075 ts_tablet_manager.cc:1428] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9: Time spent starting tablet: real 0.045s user 0.019s sys 0.022s
I20260806 10:43:14.571590 2044 heartbeater.cc:503] Master 127.16.45.126:42169 was elected leader, sending a full tablet report...
I20260806 10:43:14.573338 2074 ts_tablet_manager.cc:1428] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b: Time spent starting tablet: real 0.042s user 0.009s sys 0.027s
W20260806 10:43:14.609022 2049 tablet.cc:2369] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:43:14.762989 1856 tablet.cc:2369] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:43:14.787300 2080 raft_consensus.cc:482] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:43:14.787652 2080 raft_consensus.cc:504] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38095 } } peers { permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 } } peers { permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 } }
I20260806 10:43:14.789968 2082 raft_consensus.cc:482] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:43:14.790700 2082 raft_consensus.cc:504] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38095 } } peers { permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 } } peers { permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 } }
I20260806 10:43:14.789701 2080 leader_election.cc:288] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3773565a6cca4ee39b500d5a57ba6135 (127.16.45.65:38299), d2da97bb54344c7781daa60a1945970b (127.16.45.67:45495)
I20260806 10:43:14.794327 2082 leader_election.cc:288] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b82b6c94c32b400d8e5c1b5bff612cc9 (127.16.45.66:38095), d2da97bb54344c7781daa60a1945970b (127.16.45.67:45495)
I20260806 10:43:14.803537 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.790465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:33709 (local address 127.16.45.65:38299)
0806 10:43:14.790751 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:14.790759 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:14.792146 (+ 1387us) server_negotiation.cc:407] Connection header received
0806 10:43:14.792548 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:14.792553 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:14.792615 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:14.792705 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:43:14.794375 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.797021 (+ 2646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.800295 (+ 3274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.801928 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.802108 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.802190 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:14.803055 (+ 865us) server_negotiation.cc:299] Negotiation successful
0806 10:43:14.803202 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":66}
I20260806 10:43:14.804661 2084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.789878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38299 (local address 127.16.45.66:33709)
0806 10:43:14.791997 (+ 2119us) negotiation.cc:107] Waiting for socket to connect
0806 10:43:14.792020 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 10:43:14.792345 (+ 325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:43:14.793030 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:43:14.793035 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:43:14.793063 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:43:14.794165 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.794182 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.797141 (+ 2959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.797146 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.800098 (+ 2952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.800114 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.802533 (+ 2419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.802542 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.802818 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.802861 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 10:43:14.803915 (+ 1054us) client_negotiation.cc:240] Negotiation successful
0806 10:43:14.804070 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1891,"thread_start_us":2447,"threads_started":1}
I20260806 10:43:14.804970 2068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.793425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:57787 (local address 127.16.45.66:38095)
0806 10:43:14.793668 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:14.793674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:14.795017 (+ 1343us) server_negotiation.cc:407] Connection header received
0806 10:43:14.795230 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:14.795235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:14.795305 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:14.795387 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:43:14.796798 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.798453 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.801643 (+ 3190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.803340 (+ 1697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.803452 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.803519 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:14.804312 (+ 793us) server_negotiation.cc:299] Negotiation successful
0806 10:43:14.804440 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":54}
I20260806 10:43:14.806128 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.790080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:41381 (local address 127.16.45.67:45495)
0806 10:43:14.790273 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:14.790279 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:14.792870 (+ 2591us) server_negotiation.cc:407] Connection header received
0806 10:43:14.793090 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:14.793096 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:14.793178 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:14.793284 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:43:14.795368 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.796599 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.802439 (+ 5840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.804263 (+ 1824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.804427 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.804501 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:14.805577 (+ 1076us) server_negotiation.cc:299] Negotiation successful
0806 10:43:14.805772 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:43:14.806528 2086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.793279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:38095 (local address 127.16.45.65:57787)
0806 10:43:14.794915 (+ 1636us) negotiation.cc:107] Waiting for socket to connect
0806 10:43:14.794934 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:43:14.795097 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:43:14.795532 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:43:14.795537 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:43:14.795563 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:43:14.796619 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.796634 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.798605 (+ 1971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.798610 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.801421 (+ 2811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.801436 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.803823 (+ 2387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.803831 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.804083 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.804117 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 10:43:14.805372 (+ 1255us) client_negotiation.cc:240] Negotiation successful
0806 10:43:14.805529 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1516,"mutex_wait_us":4,"thread_start_us":1189,"threads_started":1}
I20260806 10:43:14.806185 1593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d384af78ce420fad402ce937d0456b" candidate_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3773565a6cca4ee39b500d5a57ba6135" is_pre_election: true
I20260806 10:43:14.807179 1593 raft_consensus.cc:2454] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82b6c94c32b400d8e5c1b5bff612cc9 in term 0.
I20260806 10:43:14.807663 2083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.790177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:45495 (local address 127.16.45.66:41381)
0806 10:43:14.792728 (+ 2551us) negotiation.cc:107] Waiting for socket to connect
0806 10:43:14.792747 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:43:14.792942 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:43:14.793520 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:43:14.793524 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:43:14.793556 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:43:14.795094 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.795108 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.796794 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.796800 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.802180 (+ 5380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.802194 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.805131 (+ 2937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.805140 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.805377 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.805409 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 10:43:14.806542 (+ 1133us) client_negotiation.cc:240] Negotiation successful
0806 10:43:14.806727 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2331,"mutex_wait_us":5,"thread_start_us":1024,"threads_started":1}
I20260806 10:43:14.808445 1701 leader_election.cc:302] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3773565a6cca4ee39b500d5a57ba6135, b82b6c94c32b400d8e5c1b5bff612cc9; no voters:
I20260806 10:43:14.808300 1795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d384af78ce420fad402ce937d0456b" candidate_uuid: "3773565a6cca4ee39b500d5a57ba6135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" is_pre_election: true
I20260806 10:43:14.809111 2080 raft_consensus.cc:2781] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:43:14.809420 2089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.795714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:45495 (local address 127.16.45.65:55337)
0806 10:43:14.797990 (+ 2276us) negotiation.cc:107] Waiting for socket to connect
0806 10:43:14.798008 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:43:14.798131 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:43:14.798469 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:43:14.798474 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:43:14.798500 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:43:14.799324 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.799340 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.801803 (+ 2463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.801808 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.804413 (+ 2605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:43:14.804427 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.807378 (+ 2951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.807385 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:43:14.807614 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.807647 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 10:43:14.807737 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 10:43:14.807873 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2112,"thread_start_us":1913,"threads_started":1}
I20260806 10:43:14.809414 1795 raft_consensus.cc:2454] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3773565a6cca4ee39b500d5a57ba6135 in term 0.
W20260806 10:43:14.809723 1656 tablet.cc:2369] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:43:14.809849 1986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d384af78ce420fad402ce937d0456b" candidate_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2da97bb54344c7781daa60a1945970b" is_pre_election: true
I20260806 10:43:14.810343 2080 raft_consensus.cc:482] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:43:14.810572 2080 raft_consensus.cc:3037] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:43:14.810544 1986 raft_consensus.cc:2454] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82b6c94c32b400d8e5c1b5bff612cc9 in term 0.
I20260806 10:43:14.810997 1490 leader_election.cc:302] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3773565a6cca4ee39b500d5a57ba6135, b82b6c94c32b400d8e5c1b5bff612cc9; no voters:
I20260806 10:43:14.811159 2087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.794415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:55337 (local address 127.16.45.67:45495)
0806 10:43:14.795142 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:14.795146 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:14.798110 (+ 2964us) server_negotiation.cc:407] Connection header received
0806 10:43:14.798243 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:14.798248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:14.798348 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:14.798450 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:43:14.799528 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.801646 (+ 2118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.804588 (+ 2942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.806830 (+ 2242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.806985 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.807052 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:14.808004 (+ 952us) server_negotiation.cc:299] Negotiation successful
0806 10:43:14.808174 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":446,"threads_started":1}
I20260806 10:43:14.811992 2082 raft_consensus.cc:2781] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:43:14.812104 1986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d384af78ce420fad402ce937d0456b" candidate_uuid: "3773565a6cca4ee39b500d5a57ba6135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2da97bb54344c7781daa60a1945970b" is_pre_election: true
I20260806 10:43:14.812152 2082 raft_consensus.cc:482] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:43:14.812300 2082 raft_consensus.cc:3037] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:43:14.812387 1986 raft_consensus.cc:2454] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3773565a6cca4ee39b500d5a57ba6135 in term 0.
I20260806 10:43:14.814502 2080 raft_consensus.cc:504] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38095 } } peers { permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 } } peers { permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 } }
I20260806 10:43:14.816046 2080 leader_election.cc:288] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [CANDIDATE]: Term 1 election: Requested vote from peers 3773565a6cca4ee39b500d5a57ba6135 (127.16.45.65:38299), d2da97bb54344c7781daa60a1945970b (127.16.45.67:45495)
I20260806 10:43:14.815903 2082 raft_consensus.cc:504] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38095 } } peers { permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 } } peers { permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 } }
I20260806 10:43:14.816524 1986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d384af78ce420fad402ce937d0456b" candidate_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2da97bb54344c7781daa60a1945970b"
I20260806 10:43:14.816555 1593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d384af78ce420fad402ce937d0456b" candidate_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3773565a6cca4ee39b500d5a57ba6135"
I20260806 10:43:14.816787 1986 raft_consensus.cc:3037] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:43:14.816897 1593 raft_consensus.cc:2379] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b82b6c94c32b400d8e5c1b5bff612cc9 in current term 1: Already voted for candidate 3773565a6cca4ee39b500d5a57ba6135 in this term.
I20260806 10:43:14.817065 2082 leader_election.cc:288] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [CANDIDATE]: Term 1 election: Requested vote from peers b82b6c94c32b400d8e5c1b5bff612cc9 (127.16.45.66:38095), d2da97bb54344c7781daa60a1945970b (127.16.45.67:45495)
I20260806 10:43:14.818006 1795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d384af78ce420fad402ce937d0456b" candidate_uuid: "3773565a6cca4ee39b500d5a57ba6135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9"
I20260806 10:43:14.818416 1795 raft_consensus.cc:2379] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3773565a6cca4ee39b500d5a57ba6135 in current term 1: Already voted for candidate b82b6c94c32b400d8e5c1b5bff612cc9 in this term.
I20260806 10:43:14.819118 1985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1d384af78ce420fad402ce937d0456b" candidate_uuid: "3773565a6cca4ee39b500d5a57ba6135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2da97bb54344c7781daa60a1945970b"
I20260806 10:43:14.820446 1492 leader_election.cc:302] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3773565a6cca4ee39b500d5a57ba6135; no voters: b82b6c94c32b400d8e5c1b5bff612cc9, d2da97bb54344c7781daa60a1945970b
I20260806 10:43:14.820904 2082 raft_consensus.cc:2726] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260806 10:43:14.822279 1986 raft_consensus.cc:2454] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82b6c94c32b400d8e5c1b5bff612cc9 in term 1.
I20260806 10:43:14.822803 1703 leader_election.cc:302] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b82b6c94c32b400d8e5c1b5bff612cc9, d2da97bb54344c7781daa60a1945970b; no voters: 3773565a6cca4ee39b500d5a57ba6135
I20260806 10:43:14.823287 2080 raft_consensus.cc:2781] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:43:14.824205 2080 raft_consensus.cc:686] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 1 LEADER]: Becoming Leader. State: Replica: b82b6c94c32b400d8e5c1b5bff612cc9, State: Running, Role: LEADER
I20260806 10:43:14.824818 2080 consensus_queue.cc:237] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38095 } } peers { permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 } } peers { permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 } }
I20260806 10:43:14.830381 1332 catalog_manager.cc:5495] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b82b6c94c32b400d8e5c1b5bff612cc9 (127.16.45.66). New cstate: current_term: 1 leader_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82b6c94c32b400d8e5c1b5bff612cc9" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 38095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 } health_report { overall_health: UNKNOWN } } }
I20260806 10:43:14.928941 2068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.923184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58048 (local address 127.16.45.66:38095)
0806 10:43:14.923366 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:14.923373 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:14.923449 (+ 76us) server_negotiation.cc:407] Connection header received
0806 10:43:14.923691 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:14.923695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:14.923773 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:14.923907 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:43:14.924341 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.925125 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.926689 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.927085 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.927198 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:14.927718 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:43:14.928330 (+ 612us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:43:14.928481 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:14.928595 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 10:43:14.928664 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 10:43:14.938191 1986 raft_consensus.cc:1261] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b [term 1 FOLLOWER]: Refusing update from remote peer b82b6c94c32b400d8e5c1b5bff612cc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:43:14.938544 1593 raft_consensus.cc:1261] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 1 FOLLOWER]: Refusing update from remote peer b82b6c94c32b400d8e5c1b5bff612cc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:43:14.939251 2090 consensus_queue.cc:1035] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2da97bb54344c7781daa60a1945970b" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 45495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:43:14.939798 2080 consensus_queue.cc:1035] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3773565a6cca4ee39b500d5a57ba6135" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:43:14.955466 2098 mvcc.cc:205] Tried to move back new op lower bound from 7315509227257028608 to 7315509226807660544. Current Snapshot: MvccSnapshot[applied={T|T < 7315509227257028608}]
I20260806 10:43:14.968003 1332 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:43:14.968341 1332 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:43:14.972563 1332 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24b239874bf3478bb8b130ef4f163b74: Sending DeleteTablet for 3 replicas of tablet d1d384af78ce420fad402ce937d0456b
I20260806 10:43:14.974004 1951 tablet_service.cc:1514] Processing DeleteTablet for tablet d1d384af78ce420fad402ce937d0456b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:43:14 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:56360
I20260806 10:43:14.974031 1561 tablet_service.cc:1514] Processing DeleteTablet for tablet d1d384af78ce420fad402ce937d0456b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:43:14 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:48818
I20260806 10:43:14.974130 1765 tablet_service.cc:1514] Processing DeleteTablet for tablet d1d384af78ce420fad402ce937d0456b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:43:14 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:58036
I20260806 10:43:14.976308 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 1455
I20260806 10:43:14.982954 2108 tablet_replica.cc:330] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135: stopping tablet replica
I20260806 10:43:14.983644 2107 tablet_replica.cc:330] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b: stopping tablet replica
I20260806 10:43:14.984248 2107 raft_consensus.cc:2229] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:43:14.984839 2108 raft_consensus.cc:2229] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:43:14.985473 2108 raft_consensus.cc:2258] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:43:14.985983 2107 raft_consensus.cc:2258] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:43:14.987083 2106 tablet_replica.cc:330] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9: stopping tablet replica
I20260806 10:43:14.987491 2106 raft_consensus.cc:2229] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:43:14.988175 2106 raft_consensus.cc:2258] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:43:14.988277 2108 ts_tablet_manager.cc:1905] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:43:14.990391 2106 ts_tablet_manager.cc:1905] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:43:14.994027 2107 ts_tablet_manager.cc:1905] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:43:14.995395 2108 ts_tablet_manager.cc:1918] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:43:14.995630 2108 log.cc:1196] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/d1d384af78ce420fad402ce937d0456b
I20260806 10:43:14.996207 2108 ts_tablet_manager.cc:1939] T d1d384af78ce420fad402ce937d0456b P 3773565a6cca4ee39b500d5a57ba6135: Deleting consensus metadata
I20260806 10:43:14.998066 2106 ts_tablet_manager.cc:1918] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:43:14.998365 2106 log.cc:1196] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/d1d384af78ce420fad402ce937d0456b
I20260806 10:43:14.998356 1312 catalog_manager.cc:4841] TS 3773565a6cca4ee39b500d5a57ba6135 (127.16.45.65:38299): tablet d1d384af78ce420fad402ce937d0456b (table test-table [id=e939533365564f45aa218701c0060291]) successfully deleted
I20260806 10:43:14.999099 2106 ts_tablet_manager.cc:1939] T d1d384af78ce420fad402ce937d0456b P b82b6c94c32b400d8e5c1b5bff612cc9: Deleting consensus metadata
I20260806 10:43:15.001123 1312 catalog_manager.cc:4841] TS b82b6c94c32b400d8e5c1b5bff612cc9 (127.16.45.66:38095): tablet d1d384af78ce420fad402ce937d0456b (table test-table [id=e939533365564f45aa218701c0060291]) successfully deleted
I20260806 10:43:15.002478 2107 ts_tablet_manager.cc:1918] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:43:15.002667 2107 log.cc:1196] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/d1d384af78ce420fad402ce937d0456b
Aug 06 10:43:14 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:43:15.003242 2107 ts_tablet_manager.cc:1939] T d1d384af78ce420fad402ce937d0456b P d2da97bb54344c7781daa60a1945970b: Deleting consensus metadata
I20260806 10:43:15.005216 1314 catalog_manager.cc:4841] TS d2da97bb54344c7781daa60a1945970b (127.16.45.67:45495): tablet d1d384af78ce420fad402ce937d0456b (table test-table [id=e939533365564f45aa218701c0060291]) successfully deleted
I20260806 10:43:15.013789 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:14.977954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48826 (local address 127.16.45.65:38299)
0806 10:43:14.978188 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:14.978196 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:14.982575 (+ 4379us) server_negotiation.cc:407] Connection header received
0806 10:43:14.983015 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:14.983021 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:14.983108 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:14.983190 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:43:14.985431 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.986564 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.988511 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:14.989124 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:14.989248 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:15.004678 (+ 15430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:43:15.004699 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:43:15.004719 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:43:15.004770 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:43:15.009623 (+ 4853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:15.010866 (+ 1243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:15.010874 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:15.010877 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:15.011099 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:15.011721 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:15.011725 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:15.011727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:15.012383 (+ 656us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:43:15.012750 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:15.013146 (+ 396us) server_negotiation.cc:299] Negotiation successful
0806 10:43:15.013323 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 10:43:15.014464 1648 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:43:15.108188 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 1455
I20260806 10:43:15.134748 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 1662
Aug 06 10:43:15 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:43:15.150494 2068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:15.135525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58050 (local address 127.16.45.66:38095)
0806 10:43:15.135739 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:15.135745 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:15.135769 (+ 24us) server_negotiation.cc:407] Connection header received
0806 10:43:15.135989 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:15.135997 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:15.136093 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:15.136185 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:43:15.137543 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:15.138292 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:15.139651 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:15.140096 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:15.140205 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:15.144491 (+ 4286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:43:15.144505 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:43:15.144521 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:43:15.144554 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:43:15.147667 (+ 3113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:15.148303 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:15.148311 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:15.148313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:15.148460 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:15.148849 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:15.148852 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:15.148854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:15.149250 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:43:15.149552 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:15.149897 (+ 345us) server_negotiation.cc:299] Negotiation successful
0806 10:43:15.150122 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 10:43:15.151177 1850 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:43:15.261857 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 1662
I20260806 10:43:15.283939 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 1862
Aug 06 10:43:15 dist-test-slave-fgb3 krb5kdc[613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:43:15.300521 2087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:43:15.284792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56364 (local address 127.16.45.67:45495)
0806 10:43:15.284992 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 10:43:15.284997 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:43:15.285016 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:43:15.285078 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:43:15.285082 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:43:15.285145 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:43:15.285253 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:43:15.286764 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:15.287519 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:15.288877 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:43:15.289321 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:43:15.289419 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:43:15.294245 (+ 4826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:43:15.294263 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:43:15.294279 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:43:15.294357 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:43:15.297326 (+ 2969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:15.298140 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:15.298149 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:15.298151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:15.298379 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:43:15.298872 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:43:15.298875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:43:15.298877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:43:15.299260 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:43:15.299531 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0806 10:43:15.299809 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 10:43:15.300076 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 10:43:15.301362 2037 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:43:15.391832 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 1862
I20260806 10:43:15.411186 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 1290
I20260806 10:43:15.412552 1378 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:43:15.525138 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 1290
I20260806 10:43:15.555192 16565 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 10:43:15.900825 16565 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 10:43:15.901135 16565 mini_ranger.cc:66] Stopping Ranger...
I20260806 10:43:16.246876 16565 mini_ranger.cc:68] Stopped Ranger
2026-08-06 10:43:16.247 UTC [660] LOG: received smart shutdown request
2026-08-06 10:43:16.251 UTC [660] LOG: background worker "logical replication launcher" (PID 674) exited with exit code 1
2026-08-06 10:43:16.251 UTC [666] LOG: shutting down
2026-08-06 10:43:16.419 UTC [660] LOG: database system is shut down
2026-08-06T10:43:16Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51820 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:43:16 dist-test-slave-fgb3 krb5kdc[2131](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:43:16 dist-test-slave-fgb3 krb5kdc[2131](info): set up 2 sockets
Aug 06 10:43:16 dist-test-slave-fgb3 krb5kdc[2131](info): commencing operation
krb5kdc: starting...
W20260806 10:43:17.743834 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:43:17 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786012997, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:43:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:43:17Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.16.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.16.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/rangeradmin_127.16.45.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/rangeradmin_127.16.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.16.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.16.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/rangerlookup_127.16.45.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/rangerlookup_127.16.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.16.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.16.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/HTTP_127.16.45.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/HTTP_127.16.45.84@KRBTEST.COM.keytab.
I20260806 10:43:18.125552 16565 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskYt67r8/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/postgres -l logfile start
2026-08-06 10:43:20.734 UTC [2177] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 10:43:20.734 UTC [2177] LOG: listening on IPv4 address "127.16.45.84", port 36081
2026-08-06 10:43:20.738 UTC [2177] LOG: listening on Unix socket "/tmp/.s.PGSQL.36081"
2026-08-06 10:43:20.760 UTC [2180] LOG: database system was shut down at 2026-08-06 10:43:19 UTC
2026-08-06 10:43:20.764 UTC [2177] LOG: database system is ready to accept connections
I20260806 10:43:21.819686 16565 mini_postgres.cc:96] Postgres bound to 36081
2026-08-06 10:43:21.841 UTC [2191] FATAL: database "slave" does not exist
127.16.45.84:36081 - accepting connections
I20260806 10:43:21.841825 16565 mini_ranger.cc:161] Starting Ranger...
I20260806 10:43:21.871984 16565 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 10:43:22.403925 16565 mini_ranger.cc:87] Created ranger Postgres database
I20260806 10:43:22.404034 16565 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-admin
2026-08-06 10:43:22,673 [I] DB FLAVOR :POSTGRES
2026-08-06 10:43:22,673 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 10:43:22,673 [I] Checking connection..
2026-08-06 10:43:22,674 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 10:43:22,934 [I] Checking connection passed.
2026-08-06 10:43:22,934 [I] --------- Verifying version history table ---------
2026-08-06 10:43:22,934 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 10:43:23,198 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 10:43:23,198 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 10:43:23,461 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 10:43:23,461 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 10:43:23,462 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 10:43:23.730 UTC [2278] WARNING: there is no transaction in progress
2026-08-06 10:43:23,738 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 10:43:23,739 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 10:43:23,997 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 10:43:23,998 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 10:43:23,998 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 10:43:24,254 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 10:43:24,516 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-fgb3.c.gcp-upstream.internal','N') ;"
2026-08-06 10:43:24,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 10:43:25,019 [I] Table x_portal_user does not exist in database ranger
2026-08-06 10:43:25,020 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 10:43:25,289 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 10:43:25,290 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 10:43:25,560 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 10:43:25,814 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 10:43:25,815 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 10:43:26.778 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.793 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.809 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.824 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.839 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.856 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.909 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.915 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.928 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.938 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.948 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.961 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.970 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.976 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.983 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:26.989 UTC [2429] WARNING: there is no transaction in progress
2026-08-06 10:43:27,619 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 10:43:27,620 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 10:43:27,878 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 10:43:27,879 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 10:43:28,149 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 10:43:28,149 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 10:43:28,393 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 10:43:28,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 10:43:28,654 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 10:43:28,918 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-fgb3.c.gcp-upstream.internal';"
2026-08-06 10:43:29,169 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 10:43:29,169 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 10:43:29,420 [I] DB_PATCHES have already been applied
I20260806 10:43:29.426854 16565 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-admin:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskYt67r8/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 10:43:29.426947 16565 mini_ranger.cc:193] Using host: 127.16.45.84
I20260806 10:43:29.445606 16565 mini_ranger.cc:227] Ranger admin URL: http://127.16.45.84:51213
Aug 06, 2026 10:43:29 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 10:43:29 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 10:43:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 10:43:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 10:43:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 10:43:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 10:43:30 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 10:43:30.702977 16565 mini_ranger.cc:160] Time spent starting Ranger: real 8.861s user 0.002s sys 0.057s
Aug 06, 2026 10:43:50 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 10:43:50 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 06, 2026 10:43:50 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 10:43:50 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 10:43:50 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 10:43:51 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 10:43:51.966730 16565 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.16.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.16.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/rangerkms_127.16.45.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.16.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/rangerkms_127.16.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.16.45.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.16.45.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.16.45.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/HTTP_127.16.45.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.16.45.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/HTTP_127.16.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 10:43:52 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013032, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 10:43:52.177614 16565 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 10:43:52.205470 16565 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 10:43:53.059782 16565 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 10:43:53.059890 16565 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-kms
I20260806 10:43:53.059931 16565 mini_ranger_kms.cc:227] Using postgres at 127.16.45.84:36081
2026-08-06 10:43:53,400 [I] DB FLAVOR :POSTGRES
2026-08-06 10:43:53,400 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 10:43:53,400 [I] Checking connection
2026-08-06 10:43:53,400 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 10:43:53,642 [I] connection success
2026-08-06 10:43:53,642 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 10:43:53,643 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 10:43:53,643 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 10:43:53,887 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 10:43:53,888 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 10:43:53,888 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 10:43:53,888 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.45.84:36081/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 10:43:54,150 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 10:43:54.610172 16565 mini_ranger_kms.cc:310] Created kms service
I20260806 10:43:54.833199 16565 mini_ranger_kms.cc:326] Created kudu user
I20260806 10:43:54.879614 16565 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 10:43:54 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013032, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:43:55.245507 16565 mini_ranger_kms.cc:384] Added ranger policy
I20260806 10:43:55.245820 16565 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-kms:/tmp/dist-test-taskYt67r8/build/asan/bin/postgresql.jar:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskYt67r8/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 10:43:55.245878 16565 mini_ranger_kms.cc:240] Using host: 127.16.45.84
I20260806 10:43:55.269402 16565 mini_ranger_kms.cc:276] Ranger KMS PID: 2678
I20260806 10:43:55.269521 16565 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.16.45.84:49395
Aug 06, 2026 10:43:56 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 10:43:56 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 10:43:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 10:43:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 10:43:56 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 10:43:56 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 10:43:57 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786013037, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.45.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:43:57.640352 16565 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.463s user 0.087s sys 0.284s
I20260806 10:43:57.640599 16565 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 10:43:57.640765 16565 mini_ranger_kms.cc:401] 127.16.45.84:49395/kms/v1/keys
Aug 06 10:43:58 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013037, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.45.84@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
Aug 06 10:43:58 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013037, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.45.84@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
Aug 06 10:44:00 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:44:00.782445 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:46083
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:35719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:46083
--ranger_config_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.45.84:49395/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:01.135484 2749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:01.135794 2749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:01.135885 2749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:01.143235 2749 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:44:01.143354 2749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:01.143406 2749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:01.143462 2749 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:44:01.143509 2749 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:44:01.153883 2749 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:35719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/wal
--ranger_kms_url=127.16.45.84:49395/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:46083
--ranger_config_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:46083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:01.155177 2749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:01.156448 2749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:01.168424 2755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:01.168386 2759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:01.168449 2756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:01.169037 2749 server_base.cc:1034] running on GCE node
I20260806 10:44:01.169847 2749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:01.171403 2749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:01.172622 2749 hybrid_clock.cc:648] HybridClock initialized: now 1786013041172576 us; error 33 us; skew 500 ppm
I20260806 10:44:01.172966 2749 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:01 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013041, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:01.176192 2749 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:44:01.177723 2749 webserver.cc:460] Webserver started at http://127.16.45.126:41121/ using document root <none> and password file <none>
I20260806 10:44:01.178435 2749 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:01.178541 2749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:01.178864 2749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 10:44:01 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013041, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:44:01.248543 2749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "90a44bddf29a4830abd81ddf23babf04"
format_stamp: "Formatted at 2026-08-06 10:44:01 on dist-test-slave-fgb3"
server_key: "e01a341688161dec6f56d3cb5a68e11b"
server_key_iv: "896187eb079b8c5fd6f9c6b83709163b"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:01.249684 2749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "90a44bddf29a4830abd81ddf23babf04"
format_stamp: "Formatted at 2026-08-06 10:44:01 on dist-test-slave-fgb3"
server_key: "e01a341688161dec6f56d3cb5a68e11b"
server_key_iv: "896187eb079b8c5fd6f9c6b83709163b"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:01.256927 2749 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260806 10:44:01.278651 2771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:01.280462 2749 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 10:44:01.280673 2749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "90a44bddf29a4830abd81ddf23babf04"
format_stamp: "Formatted at 2026-08-06 10:44:01 on dist-test-slave-fgb3"
server_key: "e01a341688161dec6f56d3cb5a68e11b"
server_key_iv: "896187eb079b8c5fd6f9c6b83709163b"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:01.280962 2749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:01.308557 2749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:01.313668 2749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:01.314013 2749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:01.333580 2749 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:46083
I20260806 10:44:01.333539 2839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:46083 every 8 connection(s)
I20260806 10:44:01.335315 2749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:44:01.336603 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 2749
I20260806 10:44:01.336789 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:44:01.337447 16565 external_mini_cluster.cc:1428] Setting key ca301e3ca23c37c6457cf9e17042cb31
I20260806 10:44:01.342077 2840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:01.356997 2840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04: Bootstrap starting.
I20260806 10:44:01.360702 2840 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:01.361732 2840 log.cc:824] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:01.365195 2840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04: No bootstrap required, opened a new log
Aug 06 10:44:01 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:01.373795 2840 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90a44bddf29a4830abd81ddf23babf04" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46083 } }
I20260806 10:44:01.374197 2840 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:01.374296 2840 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90a44bddf29a4830abd81ddf23babf04, State: Initialized, Role: FOLLOWER
I20260806 10:44:01.374964 2840 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90a44bddf29a4830abd81ddf23babf04" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46083 } }
I20260806 10:44:01.375195 2840 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:44:01.375334 2840 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:44:01.375516 2840 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:01.378175 2840 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90a44bddf29a4830abd81ddf23babf04" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46083 } }
I20260806 10:44:01.378646 2843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:01.339482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49406 (local address 127.16.45.126:46083)
0806 10:44:01.354456 (+ 14974us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:01.354476 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:01.354537 (+ 61us) server_negotiation.cc:407] Connection header received
0806 10:44:01.357021 (+ 2484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:01.357053 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:01.357586 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:01.358080 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:01.359870 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:01.361914 (+ 2044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:01.363875 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:01.364895 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:01.365074 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:01.369903 (+ 4829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:01.369913 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:01.369934 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:01.369988 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:01.373786 (+ 3798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:01.374612 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:01.374620 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:01.374628 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:01.374801 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:01.375235 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:01.375251 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:01.375255 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:01.376002 (+ 747us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:01.376312 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:01.376799 (+ 487us) server_negotiation.cc:299] Negotiation successful
0806 10:44:01.377255 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14633,"thread_start_us":14412,"threads_started":1}
I20260806 10:44:01.378696 2840 leader_election.cc:302] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90a44bddf29a4830abd81ddf23babf04; no voters:
I20260806 10:44:01.379416 2840 leader_election.cc:288] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:44:01.379537 2846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:44:01.382614 2846 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 1 LEADER]: Becoming Leader. State: Replica: 90a44bddf29a4830abd81ddf23babf04, State: Running, Role: LEADER
I20260806 10:44:01.383262 2846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90a44bddf29a4830abd81ddf23babf04" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46083 } }
I20260806 10:44:01.385282 2846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90a44bddf29a4830abd81ddf23babf04. Latest consensus state: current_term: 1 leader_uuid: "90a44bddf29a4830abd81ddf23babf04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90a44bddf29a4830abd81ddf23babf04" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46083 } } }
I20260806 10:44:01.385651 2846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:01.385975 2852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90a44bddf29a4830abd81ddf23babf04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90a44bddf29a4830abd81ddf23babf04" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46083 } } }
I20260806 10:44:01.386575 2852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:01.388165 2840 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:44:01.392578 2855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:44:01.399706 2855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:44:01.411669 2855 catalog_manager.cc:1347] Generated new cluster ID: ee3e74c817f44586baf433c06f1b4ac1
I20260806 10:44:01.411799 2855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:44:01.443465 2840 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 10:44:01.445425 2855 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:44:01.447491 2855 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:44:01.455008 2855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04: Generated new TSK 0
I20260806 10:44:01.456265 2855 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:44:02.222880 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.45.84:49395/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:46083
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:35719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 10:44:02 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786013042, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 10:44:02.620764 2906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:02.621059 2906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:02.621198 2906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:02.628608 2906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:02.628731 2906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:02.628912 2906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:44:02.639107 2906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:35719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.16.45.84:49395/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:46083
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:02.640450 2906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:02.641711 2906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:02.658790 2920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:02.658790 2921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:02.666236 2924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:02.667254 2906 server_base.cc:1034] running on GCE node
I20260806 10:44:02.668187 2906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:02.670048 2906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:02.671380 2906 hybrid_clock.cc:648] HybridClock initialized: now 1786013042671272 us; error 109 us; skew 500 ppm
I20260806 10:44:02.671777 2906 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:02 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013042, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:02.676088 2906 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:44:02.686040 2906 webserver.cc:460] Webserver started at http://127.16.45.65:38625/ using document root <none> and password file <none>
I20260806 10:44:02.687168 2906 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:02.687381 2906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:02.687825 2906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 10:44:02 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013042, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:44:02.716872 2906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "55165bfc3da249bba8b705815cf45076"
format_stamp: "Formatted at 2026-08-06 10:44:02 on dist-test-slave-fgb3"
server_key: "d6c6d5b9a6be1c9f66c85ad6d605d78e"
server_key_iv: "1aeaea22d9d6160e8677b706d0f3a765"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:02.718150 2906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "55165bfc3da249bba8b705815cf45076"
format_stamp: "Formatted at 2026-08-06 10:44:02 on dist-test-slave-fgb3"
server_key: "d6c6d5b9a6be1c9f66c85ad6d605d78e"
server_key_iv: "1aeaea22d9d6160e8677b706d0f3a765"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:02.732713 2906 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.008s sys 0.004s
I20260806 10:44:02.774852 2932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:02.776607 2906 fs_manager.cc:725] Time spent opening block manager: real 0.021s user 0.008s sys 0.011s
I20260806 10:44:02.776819 2906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "55165bfc3da249bba8b705815cf45076"
format_stamp: "Formatted at 2026-08-06 10:44:02 on dist-test-slave-fgb3"
server_key: "d6c6d5b9a6be1c9f66c85ad6d605d78e"
server_key_iv: "1aeaea22d9d6160e8677b706d0f3a765"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:02.777216 2906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:02.812237 2906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:02.817694 2906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:02.818074 2906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:02.830431 2906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:02.832574 2906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:02.832760 2906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 10:44:02.832976 2906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:02.833094 2906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:02.898726 2906 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:45843
I20260806 10:44:02.898768 3095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:45843 every 8 connection(s)
I20260806 10:44:02.900653 2906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:44:02.904018 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 2906
I20260806 10:44:02.904269 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:44:02.905136 16565 external_mini_cluster.cc:1428] Setting key fcecff938c9436b54ce270fcfc2ffda4
Aug 06 10:44:02 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013042, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
I20260806 10:44:02.948321 3102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:02.909891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:43927 (local address 127.16.45.126:46083)
0806 10:44:02.918718 (+ 8827us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:02.918725 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:02.921987 (+ 3262us) server_negotiation.cc:407] Connection header received
0806 10:44:02.922048 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:02.922052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:02.922124 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:02.922217 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:02.924459 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:02.925516 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:02.928332 (+ 2816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:02.929026 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:02.929164 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:02.941018 (+ 11854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:02.941027 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:02.941033 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:02.941084 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:02.944789 (+ 3705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:02.945768 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:02.945775 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:02.945778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:02.945927 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:02.946426 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:02.946432 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:02.946436 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:02.946721 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:02.946868 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:02.947644 (+ 776us) server_negotiation.cc:299] Negotiation successful
0806 10:44:02.947886 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8672,"thread_start_us":12424,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
I20260806 10:44:02.950560 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:02.910615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:46083 (local address 127.16.45.65:43927)
0806 10:44:02.919317 (+ 8702us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:02.919372 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:02.921673 (+ 2301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:02.922803 (+ 1130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:02.922815 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:02.923481 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:02.924235 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:02.924258 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:02.926013 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:02.926020 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:02.928133 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:02.928150 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:02.929475 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:02.929483 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:02.929787 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:02.930628 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:02.930662 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:02.940628 (+ 9966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:02.945011 (+ 4383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:02.945023 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:02.945047 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:02.945611 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:02.946046 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:02.946049 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:02.946052 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:02.946280 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:02.946849 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:02.946859 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:02.947217 (+ 358us) client_negotiation.cc:769] Sending connection context
0806 10:44:02.947512 (+ 295us) client_negotiation.cc:240] Negotiation successful
0806 10:44:02.948074 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8370,"thread_start_us":8805,"threads_started":1}
I20260806 10:44:02.959369 3097 heartbeater.cc:347] Connected to a master server at 127.16.45.126:46083
I20260806 10:44:02.959692 3097 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:02.960421 3097 heartbeater.cc:511] Master 127.16.45.126:46083 requested a full tablet report, sending...
I20260806 10:44:02.962797 2791 ts_manager.cc:194] Registered new tserver with Master: 55165bfc3da249bba8b705815cf45076 (127.16.45.65:45843)
I20260806 10:44:02.964274 2791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:43927
Aug 06 10:44:02 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013042, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
W20260806 10:44:03.017810 16565 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.16.45.66: real 0.110s user 0.000s sys 0.023s
I20260806 10:44:03.018834 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.45.84:49395/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:46083
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:35719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 10:44:03 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013042, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
W20260806 10:44:03.425168 3107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:03.425705 3107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:03.425909 3107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:03.437588 3107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:03.437847 3107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:03.438133 3107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:44:03.454473 3107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:35719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.16.45.84:49395/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:46083
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:03.456555 3107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:03.458439 3107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:03.494374 3116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:03.496155 3117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:03.503996 3123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:03.505366 3107 server_base.cc:1034] running on GCE node
I20260806 10:44:03.506354 3107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:03.512848 3107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:03.516291 3107 hybrid_clock.cc:648] HybridClock initialized: now 1786013043516166 us; error 113 us; skew 500 ppm
I20260806 10:44:03.516718 3107 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:03 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013043, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:03.524173 3107 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:44:03.534224 3107 webserver.cc:460] Webserver started at http://127.16.45.66:43371/ using document root <none> and password file <none>
I20260806 10:44:03.535265 3107 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:03.535487 3107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:03.535866 3107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 10:44:03 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013043, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:44:03.556802 3107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "03f99561b47447adad0ac7bc3750c2a4"
format_stamp: "Formatted at 2026-08-06 10:44:03 on dist-test-slave-fgb3"
server_key: "7ab92e44a98610d8c4e00f68f3382516"
server_key_iv: "1da10f53cc56e12ce83df1898fb74359"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:03.563877 3107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "03f99561b47447adad0ac7bc3750c2a4"
format_stamp: "Formatted at 2026-08-06 10:44:03 on dist-test-slave-fgb3"
server_key: "7ab92e44a98610d8c4e00f68f3382516"
server_key_iv: "1da10f53cc56e12ce83df1898fb74359"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:03.574081 3107 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.002s sys 0.005s
I20260806 10:44:03.611675 3137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:03.613639 3107 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.005s sys 0.000s
I20260806 10:44:03.613858 3107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "03f99561b47447adad0ac7bc3750c2a4"
format_stamp: "Formatted at 2026-08-06 10:44:03 on dist-test-slave-fgb3"
server_key: "7ab92e44a98610d8c4e00f68f3382516"
server_key_iv: "1da10f53cc56e12ce83df1898fb74359"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:03.614108 3107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:03.631716 3107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:03.636914 3107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:03.637243 3107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:03.638470 3107 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:03.640190 3107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:03.640282 3107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:03.640446 3107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:03.640504 3107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:03.684705 3107 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:35363
I20260806 10:44:03.684724 3294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:35363 every 8 connection(s)
I20260806 10:44:03.686131 3107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:44:03.688449 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 3107
I20260806 10:44:03.688635 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:44:03.689247 16565 external_mini_cluster.cc:1428] Setting key 5093046e83ac3af2eeca2542d9120f3c
Aug 06 10:44:03 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013043, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:03.755945 3298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:03.704238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:40497 (local address 127.16.45.126:46083)
0806 10:44:03.731005 (+ 26767us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:03.731014 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:03.731050 (+ 36us) server_negotiation.cc:407] Connection header received
0806 10:44:03.736118 (+ 5068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:03.736125 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:03.736261 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:03.736376 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:03.738668 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:03.740654 (+ 1986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:03.743022 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:03.743648 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:03.743744 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:03.748225 (+ 4481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:03.748232 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:03.748236 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:03.748289 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:03.751747 (+ 3458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:03.752831 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:03.752837 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:03.752841 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:03.752995 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:03.753632 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:03.753637 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:03.753641 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:03.754031 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:03.754162 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:03.755296 (+ 1134us) server_negotiation.cc:299] Negotiation successful
0806 10:44:03.755550 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26417,"thread_start_us":26799,"threads_started":1}
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
I20260806 10:44:03.758090 3299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:03.705271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:46083 (local address 127.16.45.66:40497)
0806 10:44:03.728643 (+ 23372us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:03.728716 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:03.734059 (+ 5343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:03.736834 (+ 2775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:03.736847 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:03.737544 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:03.738442 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:03.738469 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:03.740883 (+ 2414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:03.740888 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:03.742838 (+ 1950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:03.742865 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:03.744122 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:03.744132 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:03.744448 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:03.745236 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:03.745282 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:03.747950 (+ 2668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:03.751977 (+ 4027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:03.751988 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:03.752009 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:03.752661 (+ 652us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:03.753200 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:03.753205 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:03.753209 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:03.753494 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:03.754274 (+ 780us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:03.754284 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:03.754807 (+ 523us) client_negotiation.cc:769] Sending connection context
0806 10:44:03.756308 (+ 1501us) client_negotiation.cc:240] Negotiation successful
0806 10:44:03.756911 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22910,"thread_start_us":24912,"threads_started":1}
I20260806 10:44:03.759822 3295 heartbeater.cc:347] Connected to a master server at 127.16.45.126:46083
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
I20260806 10:44:03.760147 3295 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:03.761022 3295 heartbeater.cc:511] Master 127.16.45.126:46083 requested a full tablet report, sending...
I20260806 10:44:03.767237 2791 ts_manager.cc:194] Registered new tserver with Master: 03f99561b47447adad0ac7bc3750c2a4 (127.16.45.66:35363)
I20260806 10:44:03.768292 2791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:40497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
W20260806 10:44:03.800865 16565 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.16.45.67: real 0.108s user 0.000s sys 0.025s
I20260806 10:44:03.801851 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.45.84:49395/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:46083
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:35719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:44:03.968653 3097 heartbeater.cc:503] Master 127.16.45.126:46083 was elected leader, sending a full tablet report...
W20260806 10:44:04.202862 3304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:04.203238 3304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:04.203433 3304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:04.211206 3304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:04.211350 3304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:04.211506 3304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:44:04.222250 3304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:35719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.16.45.84:49395/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:46083
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:04.223654 3304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:04.224983 3304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:04.240620 3311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:04.240721 3312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:04.241295 3314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:04.241726 3304 server_base.cc:1034] running on GCE node
I20260806 10:44:04.242376 3304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:04.243398 3304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:04.244654 3304 hybrid_clock.cc:648] HybridClock initialized: now 1786013044244600 us; error 46 us; skew 500 ppm
I20260806 10:44:04.244998 3304 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:04 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013044, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:04.248594 3304 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:44:04.250134 3304 webserver.cc:460] Webserver started at http://127.16.45.67:36807/ using document root <none> and password file <none>
I20260806 10:44:04.250849 3304 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:04.250953 3304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:04.251251 3304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 10:44:04 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013044, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:44:04.268627 3304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "da85573d32ef41c1bc928f064b446d20"
format_stamp: "Formatted at 2026-08-06 10:44:04 on dist-test-slave-fgb3"
server_key: "f010bc46fc939e0e0c92a8651a43fcf3"
server_key_iv: "cffe1196062ec4172e99e1e096921cf7"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:04.269852 3304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "da85573d32ef41c1bc928f064b446d20"
format_stamp: "Formatted at 2026-08-06 10:44:04 on dist-test-slave-fgb3"
server_key: "f010bc46fc939e0e0c92a8651a43fcf3"
server_key_iv: "cffe1196062ec4172e99e1e096921cf7"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:04.276759 3304 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 10:44:04.296949 3328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:04.298933 3304 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 10:44:04.299135 3304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "da85573d32ef41c1bc928f064b446d20"
format_stamp: "Formatted at 2026-08-06 10:44:04 on dist-test-slave-fgb3"
server_key: "f010bc46fc939e0e0c92a8651a43fcf3"
server_key_iv: "cffe1196062ec4172e99e1e096921cf7"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:04.299429 3304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:04.321406 3304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:04.325445 3304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:04.325736 3304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:04.326813 3304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:04.328269 3304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:04.328343 3304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:04.328452 3304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:04.328501 3304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:04.365404 3304 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:35527
I20260806 10:44:04.365422 3479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:35527 every 8 connection(s)
I20260806 10:44:04.366788 3304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:44:04.368289 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 3304
I20260806 10:44:04.368454 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:44:04.368922 16565 external_mini_cluster.cc:1428] Setting key da3a966cd6b9b42426b8824f3069d6d9
Aug 06 10:44:04 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013044, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:04.390831 3482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:04.370612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:60107 (local address 127.16.45.126:46083)
0806 10:44:04.372620 (+ 2008us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:04.372627 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:04.372648 (+ 21us) server_negotiation.cc:407] Connection header received
0806 10:44:04.374913 (+ 2265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:04.374917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:04.374985 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:04.375077 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:04.376875 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:04.377615 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:04.379934 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:04.380360 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:04.380459 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:04.384751 (+ 4292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:04.384756 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:04.384759 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:04.384792 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:04.387624 (+ 2832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:04.388444 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:04.388449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:04.388451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:04.388579 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:04.389017 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:04.389021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:04.389023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:04.389342 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:04.389479 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:04.390188 (+ 709us) server_negotiation.cc:299] Negotiation successful
0806 10:44:04.390450 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":485,"threads_started":1}
I20260806 10:44:04.391861 3483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:04.371437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:46083 (local address 127.16.45.67:60107)
0806 10:44:04.372318 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:04.372365 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:04.374618 (+ 2253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:04.375328 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:04.375339 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:04.375914 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:04.376695 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:04.376720 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:04.377762 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:04.377767 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:04.379754 (+ 1987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:04.379782 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:04.380572 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:04.380578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:04.380903 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:04.381647 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:04.381677 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:04.384537 (+ 2860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:04.387763 (+ 3226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:04.387773 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:04.387792 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:04.388314 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:04.388683 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:04.388688 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:04.388692 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:04.388903 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:04.389474 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:04.389483 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:04.389815 (+ 332us) client_negotiation.cc:769] Sending connection context
0806 10:44:04.390066 (+ 251us) client_negotiation.cc:240] Negotiation successful
0806 10:44:04.390709 (+ 643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":366,"threads_started":1}
I20260806 10:44:04.393172 3480 heartbeater.cc:347] Connected to a master server at 127.16.45.126:46083
I20260806 10:44:04.393513 3480 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:04.394536 3480 heartbeater.cc:511] Master 127.16.45.126:46083 requested a full tablet report, sending...
I20260806 10:44:04.396741 2790 ts_manager.cc:194] Registered new tserver with Master: da85573d32ef41c1bc928f064b446d20 (127.16.45.67:35527)
I20260806 10:44:04.397897 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:44:04.397930 2790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:60107
I20260806 10:44:04.400393 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 2906
Aug 06 10:44:04 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:44:04.418620 3485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:04.401497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39110 (local address 127.16.45.65:45843)
0806 10:44:04.403866 (+ 2369us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:04.403872 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:04.403897 (+ 25us) server_negotiation.cc:407] Connection header received
0806 10:44:04.403954 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:04.403960 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:04.404150 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:04.404282 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:04.405903 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:04.406978 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:04.408468 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:04.409006 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:04.409119 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:04.413127 (+ 4008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:04.413138 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:04.413153 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:04.413189 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:04.415792 (+ 2603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:04.416498 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:04.416505 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:04.416508 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:04.416652 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:04.417021 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:04.417025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:04.417027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:04.417351 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:04.417650 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:04.417956 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 10:44:04.418230 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2206,"thread_start_us":2072,"threads_started":1}
I20260806 10:44:04.420079 3088 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:04.500978 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 2906
I20260806 10:44:04.519340 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 3107
Aug 06 10:44:04 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:44:04.538991 3487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:04.520229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46710 (local address 127.16.45.66:35363)
0806 10:44:04.520766 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:04.520773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:04.520800 (+ 27us) server_negotiation.cc:407] Connection header received
0806 10:44:04.520863 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:04.520869 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:04.521072 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:04.521215 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:04.522549 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:04.523572 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:04.524831 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:04.525381 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:04.525477 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:04.533745 (+ 8268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:04.533759 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:04.533775 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:04.533820 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:04.536489 (+ 2669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:04.537142 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:04.537148 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:04.537151 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:04.537292 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:04.537586 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:04.537588 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:04.537590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:04.537937 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:04.538163 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:04.538452 (+ 289us) server_negotiation.cc:299] Negotiation successful
0806 10:44:04.538689 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":280,"threads_started":1}
I20260806 10:44:04.540273 3288 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:04.621537 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 3107
I20260806 10:44:04.640798 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 3304
Aug 06 10:44:04 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:44:04.658227 3493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:04.641966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59950 (local address 127.16.45.67:35527)
0806 10:44:04.642684 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:04.642691 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:04.642721 (+ 30us) server_negotiation.cc:407] Connection header received
0806 10:44:04.642786 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:04.642792 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:04.643027 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:04.643156 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:04.644482 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:04.645513 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:04.646893 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:04.647464 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:04.647561 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:04.651682 (+ 4121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:04.651697 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:04.651712 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:04.651755 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:04.655561 (+ 3806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:04.656244 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:04.656252 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:04.656254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:04.656411 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:04.656714 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:04.656716 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:04.656719 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:04.657065 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:04.657313 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:04.657618 (+ 305us) server_negotiation.cc:299] Negotiation successful
0806 10:44:04.657838 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":398,"threads_started":1}
I20260806 10:44:04.659619 3475 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:04.742904 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 3304
I20260806 10:44:04.759688 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 2749
I20260806 10:44:04.760957 2832 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:04.868412 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 2749
I20260806 10:44:04.895717 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:46083
--webserver_interface=127.16.45.126
--webserver_port=41121
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:35719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:46083
--ranger_config_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.45.84:49395/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.16.45.84:49395/kms with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:05.228391 3496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:05.228755 3496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:05.228897 3496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:05.236296 3496 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:44:05.236449 3496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:05.236541 3496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:05.236624 3496 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:44:05.236698 3496 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:44:05.247354 3496 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:35719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.16.45.84:49395/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:46083
--ranger_config_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:46083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=41121
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:05.248713 3496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:05.250116 3496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:05.262355 3506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:05.262435 3505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:05.262399 3509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:05.263437 3496 server_base.cc:1034] running on GCE node
I20260806 10:44:05.264292 3496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:05.265836 3496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:05.267071 3496 hybrid_clock.cc:648] HybridClock initialized: now 1786013045267011 us; error 51 us; skew 500 ppm
I20260806 10:44:05.267495 3496 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:05 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013045, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:05.270836 3496 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:44:05.272446 3496 webserver.cc:460] Webserver started at http://127.16.45.126:41121/ using document root <none> and password file <none>
I20260806 10:44:05.273133 3496 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:05.273267 3496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 10:44:05 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013045, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:44:05.320359 3496 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 10:44:05.324501 3518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:05.326007 3496 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 10:44:05.326215 3496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "90a44bddf29a4830abd81ddf23babf04"
format_stamp: "Formatted at 2026-08-06 10:44:01 on dist-test-slave-fgb3"
server_key: "e01a341688161dec6f56d3cb5a68e11b"
server_key_iv: "896187eb079b8c5fd6f9c6b83709163b"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:05.327275 3496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:05.355036 3496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:05.359288 3496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:05.359566 3496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:05.377513 3496 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:46083
I20260806 10:44:05.377547 3591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:46083 every 8 connection(s)
I20260806 10:44:05.379192 3496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:44:05.382283 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 3496
I20260806 10:44:05.383388 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.45.84:49395/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:45843
--local_ip_for_outbound_sockets=127.16.45.65
--tserver_master_addrs=127.16.45.126:46083
--webserver_port=38625
--webserver_interface=127.16.45.65
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:35719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.16.45.84:49395/kms with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:44:05.387712 3592 sys_catalog.cc:263] Verifying existing consensus state
I20260806 10:44:05.392083 3592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04: Bootstrap starting.
I20260806 10:44:05.411406 3592 log.cc:824] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:05.420538 3592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 10:44:05.421087 3592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04: Bootstrap complete.
I20260806 10:44:05.430192 3592 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90a44bddf29a4830abd81ddf23babf04" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46083 } }
I20260806 10:44:05.431257 3592 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90a44bddf29a4830abd81ddf23babf04, State: Initialized, Role: FOLLOWER
I20260806 10:44:05.431900 3592 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90a44bddf29a4830abd81ddf23babf04" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46083 } }
I20260806 10:44:05.432122 3592 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:44:05.432250 3592 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:44:05.432421 3592 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 1 FOLLOWER]: Advancing to term 2
I20260806 10:44:05.436450 3592 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90a44bddf29a4830abd81ddf23babf04" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46083 } }
I20260806 10:44:05.436965 3592 leader_election.cc:302] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90a44bddf29a4830abd81ddf23babf04; no voters:
I20260806 10:44:05.437561 3592 leader_election.cc:288] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 10:44:05.437712 3598 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 10:44:05.438918 3598 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [term 2 LEADER]: Becoming Leader. State: Replica: 90a44bddf29a4830abd81ddf23babf04, State: Running, Role: LEADER
I20260806 10:44:05.439579 3598 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90a44bddf29a4830abd81ddf23babf04" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46083 } }
I20260806 10:44:05.439958 3592 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:44:05.442203 3599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "90a44bddf29a4830abd81ddf23babf04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90a44bddf29a4830abd81ddf23babf04" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46083 } } }
I20260806 10:44:05.442633 3599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:05.447561 3600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90a44bddf29a4830abd81ddf23babf04. Latest consensus state: current_term: 2 leader_uuid: "90a44bddf29a4830abd81ddf23babf04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90a44bddf29a4830abd81ddf23babf04" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46083 } } }
I20260806 10:44:05.447908 3600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04 [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:05.450525 3606 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:44:05.457176 3606 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:44:05.458734 3606 catalog_manager.cc:1259] Loaded cluster ID: ee3e74c817f44586baf433c06f1b4ac1
I20260806 10:44:05.458909 3606 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:44:05.463138 3606 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:44:05.464787 3606 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04: Loaded TSK: 0
I20260806 10:44:05.466485 3606 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:44:05.469168 3592 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260806 10:44:05.807406 3594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:05.807924 3594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:05.808128 3594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:05.819916 3594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:05.820171 3594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:05.820430 3594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:44:05.833416 3594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:35719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.16.45.84:49395/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:45843
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=38625
--tserver_master_addrs=127.16.45.126:46083
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:05.834985 3594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:05.836819 3594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:05.874359 3644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:05.874275 3645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:05.875370 3649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:05.875867 3594 server_base.cc:1034] running on GCE node
I20260806 10:44:05.876730 3594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:05.878152 3594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:05.879465 3594 hybrid_clock.cc:648] HybridClock initialized: now 1786013045879388 us; error 60 us; skew 500 ppm
I20260806 10:44:05.879891 3594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:05 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013045, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:05.884394 3594 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:44:05.900130 3594 webserver.cc:460] Webserver started at http://127.16.45.65:38625/ using document root <none> and password file <none>
I20260806 10:44:05.901197 3594 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:05.901391 3594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 10:44:05 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013045, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:44:05.938565 3594 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:44:05.947044 3658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:05.949049 3594 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.005s sys 0.000s
I20260806 10:44:05.949261 3594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "55165bfc3da249bba8b705815cf45076"
format_stamp: "Formatted at 2026-08-06 10:44:02 on dist-test-slave-fgb3"
server_key: "d6c6d5b9a6be1c9f66c85ad6d605d78e"
server_key_iv: "1aeaea22d9d6160e8677b706d0f3a765"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:05.951460 3594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:06.011060 3594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:06.016786 3594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:06.017156 3594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:06.018581 3594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:06.020572 3594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:06.020690 3594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:06.020803 3594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:06.020879 3594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:06.099349 3594 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:45843
I20260806 10:44:06.099403 3828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:45843 every 8 connection(s)
I20260806 10:44:06.100983 3594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:44:06.103969 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 3594
I20260806 10:44:06.104803 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.45.84:49395/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:35363
--local_ip_for_outbound_sockets=127.16.45.66
--tserver_master_addrs=127.16.45.126:46083
--webserver_port=43371
--webserver_interface=127.16.45.66
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:35719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.16.45.84:49395/kms with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 10:44:06 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013045, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:06.146186 3832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:06.104591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:46083 (local address 127.16.45.65:59441)
0806 10:44:06.119666 (+ 15075us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:06.119733 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:06.122480 (+ 2747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:06.125875 (+ 3395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:06.125888 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:06.126626 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:06.127475 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:06.127503 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:06.130076 (+ 2573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:06.130082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:06.131605 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:06.131619 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:06.133173 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:06.133178 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:06.133362 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:06.134204 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:06.134228 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:06.136339 (+ 2111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:06.141024 (+ 4685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:06.141034 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:06.141051 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:06.141770 (+ 719us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:06.142356 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:06.142361 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:06.142365 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:06.142621 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:06.143571 (+ 950us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:06.143580 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:06.143983 (+ 403us) client_negotiation.cc:769] Sending connection context
0806 10:44:06.144271 (+ 288us) client_negotiation.cc:240] Negotiation successful
0806 10:44:06.144834 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14690,"thread_start_us":21684,"threads_started":1}
I20260806 10:44:06.149011 3833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:06.104593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:59441 (local address 127.16.45.126:46083)
0806 10:44:06.123521 (+ 18928us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:06.123541 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:06.123598 (+ 57us) server_negotiation.cc:407] Connection header received
0806 10:44:06.124053 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:06.124073 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:06.124628 (+ 555us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:06.125104 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:06.127744 (+ 2640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:06.129787 (+ 2043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:06.131751 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:06.132607 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:06.132802 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:06.136657 (+ 3855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:06.136669 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:06.136689 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:06.136741 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:06.140821 (+ 4080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:06.141966 (+ 1145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:06.141976 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:06.141984 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:06.142189 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:06.142756 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:06.142762 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:06.142765 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:06.143415 (+ 650us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:06.147050 (+ 3635us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:06.147334 (+ 284us) server_negotiation.cc:299] Negotiation successful
0806 10:44:06.147753 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18612,"thread_start_us":23536,"threads_started":1}
I20260806 10:44:06.152786 3829 heartbeater.cc:347] Connected to a master server at 127.16.45.126:46083
I20260806 10:44:06.153095 3829 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:06.153921 3829 heartbeater.cc:511] Master 127.16.45.126:46083 requested a full tablet report, sending...
W20260806 10:44:06.157430 3829 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:46083 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 10:44:06.157670 3829 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:06.157948 3829 heartbeater.cc:511] Master 127.16.45.126:46083 requested a full tablet report, sending...
I20260806 10:44:06.159341 3829 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:06.159650 3829 heartbeater.cc:511] Master 127.16.45.126:46083 requested a full tablet report, sending...
W20260806 10:44:06.160733 3829 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 10:44:06.490924 3834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:06.491240 3834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:06.491379 3834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:06.498780 3834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:06.498907 3834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:06.499054 3834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:44:06.510372 3834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:35719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.16.45.84:49395/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:35363
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=43371
--tserver_master_addrs=127.16.45.126:46083
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:06.511777 3834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:06.513084 3834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:06.526394 3857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:06.526425 3855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:06.526918 3853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:06.527635 3834 server_base.cc:1034] running on GCE node
I20260806 10:44:06.528247 3834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:06.529246 3834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:06.530473 3834 hybrid_clock.cc:648] HybridClock initialized: now 1786013046530423 us; error 35 us; skew 500 ppm
I20260806 10:44:06.530827 3834 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:06 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013046, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:06.535283 3834 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:44:06.541941 3834 webserver.cc:460] Webserver started at http://127.16.45.66:43371/ using document root <none> and password file <none>
I20260806 10:44:06.542963 3834 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:06.543138 3834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 10:44:06 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013046, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:44:06.569307 3834 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.005s sys 0.001s
I20260806 10:44:06.582011 3876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:06.583938 3834 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.004s sys 0.004s
I20260806 10:44:06.584187 3834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "03f99561b47447adad0ac7bc3750c2a4"
format_stamp: "Formatted at 2026-08-06 10:44:03 on dist-test-slave-fgb3"
server_key: "7ab92e44a98610d8c4e00f68f3382516"
server_key_iv: "1da10f53cc56e12ce83df1898fb74359"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:06.585526 3834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:06.622789 3834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:06.628038 3834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:06.628443 3834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:06.632012 3834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:06.635172 3834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:06.635298 3834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:06.635422 3834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:06.635505 3834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:06.704355 3834 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:35363
I20260806 10:44:06.704360 4037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:35363 every 8 connection(s)
I20260806 10:44:06.705957 3834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:44:06.714165 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 3834
I20260806 10:44:06.715132 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.45.84:49395/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:35527
--local_ip_for_outbound_sockets=127.16.45.67
--tserver_master_addrs=127.16.45.126:46083
--webserver_port=36807
--webserver_interface=127.16.45.67
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:35719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.16.45.84:49395/kms with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 10:44:06 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786013046, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 10:44:06 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013046, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:06.765759 4042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:06.708894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:38837 (local address 127.16.45.126:46083)
0806 10:44:06.725768 (+ 16874us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:06.725775 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:06.727665 (+ 1890us) server_negotiation.cc:407] Connection header received
0806 10:44:06.729350 (+ 1685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:06.729356 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:06.729445 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:06.729552 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:06.731775 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:06.732922 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:06.735238 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:06.735879 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:06.735990 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:06.748150 (+ 12160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:06.748159 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:06.748164 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:06.748216 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:06.755245 (+ 7029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:06.756344 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:06.756417 (+ 73us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:06.756422 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:06.756579 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:06.757133 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:06.757139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:06.757142 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:06.757578 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:06.757747 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:06.763814 (+ 6067us) server_negotiation.cc:299] Negotiation successful
0806 10:44:06.765384 (+ 1570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16734,"thread_start_us":16882,"threads_started":1}
I20260806 10:44:06.767990 4044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:06.709573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:46083 (local address 127.16.45.66:38837)
0806 10:44:06.726485 (+ 16912us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:06.726548 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:06.728840 (+ 2292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:06.730017 (+ 1177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:06.730030 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:06.730663 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:06.731575 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:06.731601 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:06.733102 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:06.733107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:06.735064 (+ 1957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:06.735079 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:06.736307 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:06.736314 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:06.736580 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:06.737615 (+ 1035us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:06.737653 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:06.747732 (+ 10079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:06.755479 (+ 7747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:06.755491 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:06.755514 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:06.756173 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:06.756707 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:06.756712 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:06.756716 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:06.757002 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:06.757820 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:06.757884 (+ 64us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:06.762958 (+ 5074us) client_negotiation.cc:769] Sending connection context
0806 10:44:06.763311 (+ 353us) client_negotiation.cc:240] Negotiation successful
0806 10:44:06.766686 (+ 3375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16521,"thread_start_us":16634,"threads_started":1}
I20260806 10:44:06.769846 4038 heartbeater.cc:347] Connected to a master server at 127.16.45.126:46083
I20260806 10:44:06.770160 4038 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:06.770979 4038 heartbeater.cc:511] Master 127.16.45.126:46083 requested a full tablet report, sending...
I20260806 10:44:06.772878 3542 ts_manager.cc:194] Registered new tserver with Master: 03f99561b47447adad0ac7bc3750c2a4 (127.16.45.66:35363)
I20260806 10:44:06.774959 3542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:38837
Aug 06 10:44:07 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013046, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:44:07.160902 3829 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:07.161368 3829 heartbeater.cc:511] Master 127.16.45.126:46083 requested a full tablet report, sending...
I20260806 10:44:07.162743 3542 ts_manager.cc:194] Registered new tserver with Master: 55165bfc3da249bba8b705815cf45076 (127.16.45.65:45843)
I20260806 10:44:07.164005 3542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:59441
W20260806 10:44:07.185622 4046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:07.185992 4046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:07.186151 4046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:07.193681 4046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:07.193813 4046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:07.193972 4046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:44:07.203917 4046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:35719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.16.45.84:49395/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:35527
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=36807
--tserver_master_addrs=127.16.45.126:46083
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:07.205276 4046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:07.206664 4046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:07.223335 4052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:07.224046 4053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:07.224467 4055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:07.226099 4046 server_base.cc:1034] running on GCE node
I20260806 10:44:07.226867 4046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:07.227962 4046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:07.229204 4046 hybrid_clock.cc:648] HybridClock initialized: now 1786013047229127 us; error 64 us; skew 500 ppm
I20260806 10:44:07.229547 4046 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:07 dist-test-slave-fgb3 krb5kdc[2131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013047, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:07.233100 4046 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:44:07.238066 4046 webserver.cc:460] Webserver started at http://127.16.45.67:36807/ using document root <none> and password file <none>
I20260806 10:44:07.238876 4046 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:07.239018 4046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 10:44:07 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013047, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:44:07.280537 4046 fs_manager.cc:709] Time spent opening directory manager: real 0.021s user 0.000s sys 0.019s
I20260806 10:44:07.283648 4066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:07.285158 4046 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:44:07.285346 4046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "da85573d32ef41c1bc928f064b446d20"
format_stamp: "Formatted at 2026-08-06 10:44:04 on dist-test-slave-fgb3"
server_key: "f010bc46fc939e0e0c92a8651a43fcf3"
server_key_iv: "cffe1196062ec4172e99e1e096921cf7"
server_key_version: "kuduclusterkey@0"
I20260806 10:44:07.286427 4046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:07.309917 4046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:07.318224 4046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:07.318738 4046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:07.320212 4046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:07.321703 4046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:07.321825 4046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:07.321919 4046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:07.321985 4046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:07.373618 4046 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:35527
I20260806 10:44:07.373721 4225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:35527 every 8 connection(s)
I20260806 10:44:07.375396 4046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:44:07.380975 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 4046
Aug 06 10:44:07 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013047, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:07.422727 4230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.382570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48078 (local address 127.16.45.126:46083)
0806 10:44:07.391036 (+ 8466us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:07.391042 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:07.391063 (+ 21us) server_negotiation.cc:407] Connection header received
0806 10:44:07.391122 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:07.391127 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:07.391213 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:07.391331 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:07.393712 (+ 2381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.394871 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.404952 (+ 10081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.405535 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.405660 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.409244 (+ 3584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:07.409251 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:07.409255 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:07.409305 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:07.414714 (+ 5409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:07.418424 (+ 3710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:07.418431 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:07.418434 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:07.418613 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:07.419864 (+ 1251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:07.419870 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:07.419873 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:07.420273 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:07.420551 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:07.422033 (+ 1482us) server_negotiation.cc:299] Negotiation successful
0806 10:44:07.422293 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8353,"thread_start_us":8253,"threads_started":1}
I20260806 10:44:07.426441 4231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.389719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:46083 (local address 127.16.45.67:54103)
0806 10:44:07.390707 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:07.390758 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:07.393104 (+ 2346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:07.402923 (+ 9819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:07.402937 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:07.403564 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:07.404429 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:07.404456 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.406986 (+ 2530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.406992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:07.408943 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:07.408960 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.410996 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.411005 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:07.411340 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.412115 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:07.412157 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:07.416796 (+ 4639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:07.421290 (+ 4494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:07.421301 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:07.421322 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:07.421961 (+ 639us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:07.422421 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:07.422426 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:07.422429 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:07.422727 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:07.423450 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:07.423459 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:07.423945 (+ 486us) client_negotiation.cc:769] Sending connection context
0806 10:44:07.424268 (+ 323us) client_negotiation.cc:240] Negotiation successful
0806 10:44:07.424918 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":627,"threads_started":1}
I20260806 10:44:07.427865 4234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.390346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:54103 (local address 127.16.45.126:46083)
0806 10:44:07.402098 (+ 11752us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:07.402105 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:07.402133 (+ 28us) server_negotiation.cc:407] Connection header received
0806 10:44:07.402200 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:07.402205 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:07.402373 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:07.402524 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:07.404699 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.406793 (+ 2094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.409670 (+ 2877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.410689 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.413851 (+ 3162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.417129 (+ 3278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:07.417136 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:07.417141 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:07.417194 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:07.421123 (+ 3929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:07.422112 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:07.422117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:07.422120 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:07.422250 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:07.422884 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:07.422889 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:07.422892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:07.423237 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:07.423359 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:07.427210 (+ 3851us) server_negotiation.cc:299] Negotiation successful
0806 10:44:07.427479 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11588,"thread_start_us":12355,"threads_started":1}
I20260806 10:44:07.428989 4226 heartbeater.cc:347] Connected to a master server at 127.16.45.126:46083
I20260806 10:44:07.429342 4226 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:07.430305 4226 heartbeater.cc:511] Master 127.16.45.126:46083 requested a full tablet report, sending...
I20260806 10:44:07.432126 3542 ts_manager.cc:194] Registered new tserver with Master: da85573d32ef41c1bc928f064b446d20 (127.16.45.67:35527)
I20260806 10:44:07.433188 3542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:54103
I20260806 10:44:07.440066 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 10:44:07 dist-test-slave-fgb3 krb5kdc[2131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013046, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for HTTP/127.16.45.84@KRBTEST.COM
I20260806 10:44:07.472924 4234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.444021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48086 (local address 127.16.45.126:46083)
0806 10:44:07.444668 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:07.444675 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:07.447757 (+ 3082us) server_negotiation.cc:407] Connection header received
0806 10:44:07.448224 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:07.448242 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:07.448329 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:07.448402 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:07.450814 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.451977 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.456532 (+ 4555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.457227 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.457344 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.465674 (+ 8330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:07.465683 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:07.465688 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:07.465739 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:07.469225 (+ 3486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:07.470442 (+ 1217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:07.470449 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:07.470453 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:07.470608 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:07.471055 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:07.471061 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:07.471064 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:07.471474 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:07.471707 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:07.472306 (+ 599us) server_negotiation.cc:299] Negotiation successful
0806 10:44:07.472566 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511}
I20260806 10:44:07.479976 3542 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:44:07.489969 3542 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:44:07.580914 4255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.530418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39120 (local address 127.16.45.65:45843)
0806 10:44:07.549517 (+ 19099us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:07.549527 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:07.563725 (+ 14198us) server_negotiation.cc:407] Connection header received
0806 10:44:07.566482 (+ 2757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:07.566491 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:07.566756 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:07.566936 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:07.568151 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.569900 (+ 1749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.577698 (+ 7798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.579292 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.579446 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.579695 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:07.580367 (+ 672us) server_negotiation.cc:299] Negotiation successful
0806 10:44:07.580555 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18892,"thread_start_us":18691,"threads_started":1}
I20260806 10:44:07.581733 4253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.529243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:45843 (local address 127.0.0.1:39120)
0806 10:44:07.563579 (+ 34336us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:07.563601 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:07.564807 (+ 1206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:07.567221 (+ 2414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:07.567225 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:07.567251 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:07.567585 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:07.567598 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.570097 (+ 2499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.570103 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:07.572492 (+ 2389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:07.572508 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.579845 (+ 7337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.579852 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:07.580074 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.580128 (+ 54us) client_negotiation.cc:769] Sending connection context
0806 10:44:07.581145 (+ 1017us) client_negotiation.cc:240] Negotiation successful
0806 10:44:07.581374 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34201,"thread_start_us":47891,"threads_started":1}
I20260806 10:44:07.587100 3736 tablet_service.cc:1467] Processing CreateTablet for tablet 69a918c3d54145858acf6a6fbf68f147 (DEFAULT_TABLE table=test-table [id=43f015ef3bcb436eb8ab623b0c4454d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:44:07.588322 4250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.529104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:35363 (local address 127.0.0.1:46718)
0806 10:44:07.557490 (+ 28386us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:07.557559 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:07.557788 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:07.578882 (+ 21094us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:07.578887 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:07.578918 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:07.579294 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:07.579307 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.583539 (+ 4232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.583546 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:07.585659 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:07.585676 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.587569 (+ 1893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.587576 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:07.587741 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.587776 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 10:44:07.587844 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 10:44:07.587982 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28058,"thread_start_us":28990,"threads_started":1}
I20260806 10:44:07.589514 4252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.529333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46718 (local address 127.16.45.66:35363)
0806 10:44:07.577189 (+ 47856us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:07.577199 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:07.577232 (+ 33us) server_negotiation.cc:407] Connection header received
0806 10:44:07.577337 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:07.577345 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:07.578625 (+ 1280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:07.579521 (+ 896us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:07.579780 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.583353 (+ 3573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.585869 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.587319 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.588695 (+ 1376us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.588901 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:07.588969 (+ 68us) server_negotiation.cc:299] Negotiation successful
0806 10:44:07.589140 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47671,"thread_start_us":47546,"threads_started":1}
I20260806 10:44:07.590647 3736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69a918c3d54145858acf6a6fbf68f147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:07.592861 4251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.529702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:35527 (local address 127.0.0.1:59964)
0806 10:44:07.564131 (+ 34429us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:07.564149 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:07.564613 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:07.566013 (+ 1400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:07.566020 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:07.566051 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:07.567912 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:07.567927 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.574620 (+ 6693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.574626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:07.576615 (+ 1989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:07.576631 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.592076 (+ 15445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.592082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:07.592259 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.592293 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 10:44:07.592379 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 10:44:07.592528 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34313,"thread_start_us":34583,"threads_started":1}
I20260806 10:44:07.593711 4254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.530017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59964 (local address 127.16.45.67:35527)
0806 10:44:07.556568 (+ 26551us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:07.556578 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:07.564263 (+ 7685us) server_negotiation.cc:407] Connection header received
0806 10:44:07.565028 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:07.565038 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:07.565343 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:07.565539 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:07.572694 (+ 7155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.574428 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.581557 (+ 7129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.590109 (+ 8552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.590256 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.591092 (+ 836us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:07.593182 (+ 2090us) server_negotiation.cc:299] Negotiation successful
0806 10:44:07.593369 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26338,"thread_start_us":26574,"threads_started":1}
I20260806 10:44:07.593604 3945 tablet_service.cc:1467] Processing CreateTablet for tablet 69a918c3d54145858acf6a6fbf68f147 (DEFAULT_TABLE table=test-table [id=43f015ef3bcb436eb8ab623b0c4454d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:44:07.599320 3945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69a918c3d54145858acf6a6fbf68f147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:07.602274 4138 tablet_service.cc:1467] Processing CreateTablet for tablet 69a918c3d54145858acf6a6fbf68f147 (DEFAULT_TABLE table=test-table [id=43f015ef3bcb436eb8ab623b0c4454d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:44:07.603760 4138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69a918c3d54145858acf6a6fbf68f147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:07.636255 4258 tablet_bootstrap.cc:492] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4: Bootstrap starting.
I20260806 10:44:07.641997 4258 tablet_bootstrap.cc:654] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:07.655123 4256 tablet_bootstrap.cc:492] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076: Bootstrap starting.
I20260806 10:44:07.657737 4257 tablet_bootstrap.cc:492] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20: Bootstrap starting.
I20260806 10:44:07.660292 4256 tablet_bootstrap.cc:654] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:07.661475 4257 tablet_bootstrap.cc:654] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:07.661545 4258 log.cc:824] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:07.661623 4256 log.cc:824] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:07.662658 4257 log.cc:824] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:07.671978 4258 tablet_bootstrap.cc:492] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4: No bootstrap required, opened a new log
I20260806 10:44:07.672392 4258 ts_tablet_manager.cc:1397] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4: Time spent bootstrapping tablet: real 0.036s user 0.008s sys 0.004s
I20260806 10:44:07.677374 4257 tablet_bootstrap.cc:492] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20: No bootstrap required, opened a new log
I20260806 10:44:07.677788 4257 ts_tablet_manager.cc:1397] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.004s
I20260806 10:44:07.684710 4258 raft_consensus.cc:348] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da85573d32ef41c1bc928f064b446d20" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35527 } } peers { permanent_uuid: "55165bfc3da249bba8b705815cf45076" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 45843 } } peers { permanent_uuid: "03f99561b47447adad0ac7bc3750c2a4" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35363 } }
I20260806 10:44:07.685277 4256 tablet_bootstrap.cc:492] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076: No bootstrap required, opened a new log
I20260806 10:44:07.685400 4258 raft_consensus.cc:374] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:07.685540 4258 raft_consensus.cc:729] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f99561b47447adad0ac7bc3750c2a4, State: Initialized, Role: FOLLOWER
I20260806 10:44:07.685609 4256 ts_tablet_manager.cc:1397] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.003s
I20260806 10:44:07.686406 4258 consensus_queue.cc:260] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da85573d32ef41c1bc928f064b446d20" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35527 } } peers { permanent_uuid: "55165bfc3da249bba8b705815cf45076" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 45843 } } peers { permanent_uuid: "03f99561b47447adad0ac7bc3750c2a4" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35363 } }
I20260806 10:44:07.694083 4038 heartbeater.cc:503] Master 127.16.45.126:46083 was elected leader, sending a full tablet report...
I20260806 10:44:07.695251 4258 ts_tablet_manager.cc:1428] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4: Time spent starting tablet: real 0.023s user 0.019s sys 0.000s
I20260806 10:44:07.696561 4256 raft_consensus.cc:348] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da85573d32ef41c1bc928f064b446d20" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35527 } } peers { permanent_uuid: "55165bfc3da249bba8b705815cf45076" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 45843 } } peers { permanent_uuid: "03f99561b47447adad0ac7bc3750c2a4" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35363 } }
I20260806 10:44:07.697206 4256 raft_consensus.cc:374] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:07.697431 4256 raft_consensus.cc:729] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55165bfc3da249bba8b705815cf45076, State: Initialized, Role: FOLLOWER
I20260806 10:44:07.698284 4256 consensus_queue.cc:260] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da85573d32ef41c1bc928f064b446d20" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35527 } } peers { permanent_uuid: "55165bfc3da249bba8b705815cf45076" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 45843 } } peers { permanent_uuid: "03f99561b47447adad0ac7bc3750c2a4" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35363 } }
I20260806 10:44:07.704989 4257 raft_consensus.cc:348] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da85573d32ef41c1bc928f064b446d20" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35527 } } peers { permanent_uuid: "55165bfc3da249bba8b705815cf45076" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 45843 } } peers { permanent_uuid: "03f99561b47447adad0ac7bc3750c2a4" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35363 } }
I20260806 10:44:07.705489 4257 raft_consensus.cc:374] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:07.705590 4257 raft_consensus.cc:729] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da85573d32ef41c1bc928f064b446d20, State: Initialized, Role: FOLLOWER
I20260806 10:44:07.706244 4257 consensus_queue.cc:260] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da85573d32ef41c1bc928f064b446d20" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35527 } } peers { permanent_uuid: "55165bfc3da249bba8b705815cf45076" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 45843 } } peers { permanent_uuid: "03f99561b47447adad0ac7bc3750c2a4" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35363 } }
I20260806 10:44:07.707048 4256 ts_tablet_manager.cc:1428] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076: Time spent starting tablet: real 0.021s user 0.022s sys 0.001s
I20260806 10:44:07.707619 3829 heartbeater.cc:503] Master 127.16.45.126:46083 was elected leader, sending a full tablet report...
I20260806 10:44:07.710158 4226 heartbeater.cc:503] Master 127.16.45.126:46083 was elected leader, sending a full tablet report...
I20260806 10:44:07.711915 4257 ts_tablet_manager.cc:1428] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20: Time spent starting tablet: real 0.034s user 0.012s sys 0.000s
W20260806 10:44:07.730651 4039 tablet.cc:2369] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:44:07.854480 3830 tablet.cc:2369] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:44:07.890563 4227 tablet.cc:2369] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:07.961289 4265 raft_consensus.cc:482] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:44:07.961561 4265 raft_consensus.cc:504] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da85573d32ef41c1bc928f064b446d20" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35527 } } peers { permanent_uuid: "55165bfc3da249bba8b705815cf45076" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 45843 } } peers { permanent_uuid: "03f99561b47447adad0ac7bc3750c2a4" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35363 } }
I20260806 10:44:07.963107 4265 leader_election.cc:288] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55165bfc3da249bba8b705815cf45076 (127.16.45.65:45843), 03f99561b47447adad0ac7bc3750c2a4 (127.16.45.66:35363)
I20260806 10:44:07.971546 4255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.963628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:54453 (local address 127.16.45.65:45843)
0806 10:44:07.963815 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:07.963820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:07.964498 (+ 678us) server_negotiation.cc:407] Connection header received
0806 10:44:07.964582 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:07.964588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:07.964682 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:07.964786 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:07.965532 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.966625 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.969265 (+ 2640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.970497 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.970718 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.970805 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:07.971157 (+ 352us) server_negotiation.cc:299] Negotiation successful
0806 10:44:07.971291 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 10:44:07.971544 4252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.963578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:43937 (local address 127.16.45.66:35363)
0806 10:44:07.963788 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:07.963794 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:07.964484 (+ 690us) server_negotiation.cc:407] Connection header received
0806 10:44:07.964582 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:07.964588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:07.964682 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:07.964786 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:07.965447 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.966600 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.969293 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.970518 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.970658 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.970734 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:07.971159 (+ 425us) server_negotiation.cc:299] Negotiation successful
0806 10:44:07.971294 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 10:44:07.971745 4280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.963511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:45843 (local address 127.16.45.67:54453)
0806 10:44:07.964369 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:07.964384 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:07.964473 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:07.964811 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:07.964816 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:07.964862 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:07.965367 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:07.965377 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.966769 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.966774 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:07.969069 (+ 2295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:07.969086 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.970666 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.970672 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:07.970947 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.971018 (+ 71us) client_negotiation.cc:769] Sending connection context
0806 10:44:07.971108 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 10:44:07.971288 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":759,"mutex_wait_us":180,"spinlock_wait_cycles":33536,"thread_start_us":441,"threads_started":1}
I20260806 10:44:07.972090 4278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:07.963486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:35363 (local address 127.16.45.67:43937)
0806 10:44:07.964261 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:07.964281 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:07.964446 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:07.964811 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:07.964816 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:07.964860 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:07.965286 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:07.965301 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.966757 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.966763 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:07.969079 (+ 2316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:07.969088 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:07.970719 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:07.970725 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:07.970962 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:07.971026 (+ 64us) client_negotiation.cc:769] Sending connection context
0806 10:44:07.971108 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 10:44:07.971314 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"mutex_wait_us":177,"spinlock_wait_cycles":15488,"thread_start_us":447,"threads_started":1}
I20260806 10:44:07.972738 3769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69a918c3d54145858acf6a6fbf68f147" candidate_uuid: "da85573d32ef41c1bc928f064b446d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55165bfc3da249bba8b705815cf45076" is_pre_election: true
I20260806 10:44:07.973035 3975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69a918c3d54145858acf6a6fbf68f147" candidate_uuid: "da85573d32ef41c1bc928f064b446d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f99561b47447adad0ac7bc3750c2a4" is_pre_election: true
I20260806 10:44:07.973270 3769 raft_consensus.cc:2454] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da85573d32ef41c1bc928f064b446d20 in term 0.
I20260806 10:44:07.973551 3975 raft_consensus.cc:2454] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da85573d32ef41c1bc928f064b446d20 in term 0.
I20260806 10:44:07.973986 4069 leader_election.cc:302] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55165bfc3da249bba8b705815cf45076, da85573d32ef41c1bc928f064b446d20; no voters:
I20260806 10:44:07.974447 4265 raft_consensus.cc:2781] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:44:07.974603 4265 raft_consensus.cc:482] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:44:07.974699 4265 raft_consensus.cc:3037] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:07.976835 4265 raft_consensus.cc:504] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da85573d32ef41c1bc928f064b446d20" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35527 } } peers { permanent_uuid: "55165bfc3da249bba8b705815cf45076" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 45843 } } peers { permanent_uuid: "03f99561b47447adad0ac7bc3750c2a4" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35363 } }
I20260806 10:44:07.977415 4265 leader_election.cc:288] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [CANDIDATE]: Term 1 election: Requested vote from peers 55165bfc3da249bba8b705815cf45076 (127.16.45.65:45843), 03f99561b47447adad0ac7bc3750c2a4 (127.16.45.66:35363)
I20260806 10:44:07.977891 3769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69a918c3d54145858acf6a6fbf68f147" candidate_uuid: "da85573d32ef41c1bc928f064b446d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55165bfc3da249bba8b705815cf45076"
I20260806 10:44:07.977937 3975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69a918c3d54145858acf6a6fbf68f147" candidate_uuid: "da85573d32ef41c1bc928f064b446d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03f99561b47447adad0ac7bc3750c2a4"
I20260806 10:44:07.978104 3769 raft_consensus.cc:3037] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:07.978121 3975 raft_consensus.cc:3037] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:07.980310 3975 raft_consensus.cc:2454] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da85573d32ef41c1bc928f064b446d20 in term 1.
I20260806 10:44:07.980412 3769 raft_consensus.cc:2454] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da85573d32ef41c1bc928f064b446d20 in term 1.
I20260806 10:44:07.980695 4070 leader_election.cc:302] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03f99561b47447adad0ac7bc3750c2a4, da85573d32ef41c1bc928f064b446d20; no voters:
I20260806 10:44:07.981022 4265 raft_consensus.cc:2781] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:44:07.981480 4265 raft_consensus.cc:686] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 1 LEADER]: Becoming Leader. State: Replica: da85573d32ef41c1bc928f064b446d20, State: Running, Role: LEADER
I20260806 10:44:07.982004 4265 consensus_queue.cc:237] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da85573d32ef41c1bc928f064b446d20" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35527 } } peers { permanent_uuid: "55165bfc3da249bba8b705815cf45076" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 45843 } } peers { permanent_uuid: "03f99561b47447adad0ac7bc3750c2a4" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35363 } }
I20260806 10:44:07.986717 3541 catalog_manager.cc:5495] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 reported cstate change: term changed from 0 to 1, leader changed from <none> to da85573d32ef41c1bc928f064b446d20 (127.16.45.67). New cstate: current_term: 1 leader_uuid: "da85573d32ef41c1bc928f064b446d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da85573d32ef41c1bc928f064b446d20" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55165bfc3da249bba8b705815cf45076" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 45843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03f99561b47447adad0ac7bc3750c2a4" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35363 } health_report { overall_health: UNKNOWN } } }
I20260806 10:44:08.055136 4254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:08.049362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59966 (local address 127.16.45.67:35527)
0806 10:44:08.049622 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:08.049628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:08.049859 (+ 231us) server_negotiation.cc:407] Connection header received
0806 10:44:08.050101 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:08.050105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:08.050197 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:08.050356 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:44:08.050793 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:08.051541 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:08.052982 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:08.053374 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:08.053494 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:08.053977 (+ 483us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:44:08.054564 (+ 587us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:44:08.054703 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:08.054801 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 10:44:08.054884 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 10:44:08.063422 3769 raft_consensus.cc:1261] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076 [term 1 FOLLOWER]: Refusing update from remote peer da85573d32ef41c1bc928f064b446d20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:44:08.063422 3975 raft_consensus.cc:1261] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4 [term 1 FOLLOWER]: Refusing update from remote peer da85573d32ef41c1bc928f064b446d20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:44:08.064446 4282 consensus_queue.cc:1035] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55165bfc3da249bba8b705815cf45076" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 45843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:44:08.064774 4265 consensus_queue.cc:1035] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03f99561b47447adad0ac7bc3750c2a4" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 35363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:44:08.075479 4290 mvcc.cc:205] Tried to move back new op lower bound from 7315509444857597952 to 7315509444538163200. Current Snapshot: MvccSnapshot[applied={T|T < 7315509444857597952}]
I20260806 10:44:08.075635 4291 mvcc.cc:205] Tried to move back new op lower bound from 7315509444857597952 to 7315509444538163200. Current Snapshot: MvccSnapshot[applied={T|T < 7315509444857597952}]
I20260806 10:44:08.093300 3542 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:44:08.093547 3542 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:44:08.097169 3542 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 90a44bddf29a4830abd81ddf23babf04: Sending DeleteTablet for 3 replicas of tablet 69a918c3d54145858acf6a6fbf68f147
I20260806 10:44:08.098301 4138 tablet_service.cc:1514] Processing DeleteTablet for tablet 69a918c3d54145858acf6a6fbf68f147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:44:08 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:59964
I20260806 10:44:08.098397 3736 tablet_service.cc:1514] Processing DeleteTablet for tablet 69a918c3d54145858acf6a6fbf68f147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:44:08 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:39120
I20260806 10:44:08.098374 3945 tablet_service.cc:1514] Processing DeleteTablet for tablet 69a918c3d54145858acf6a6fbf68f147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:44:08 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:46718
I20260806 10:44:08.100922 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 3594
I20260806 10:44:08.110512 4300 tablet_replica.cc:330] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20: stopping tablet replica
I20260806 10:44:08.110780 4304 tablet_replica.cc:330] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076: stopping tablet replica
I20260806 10:44:08.111032 4300 raft_consensus.cc:2229] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:44:08.111377 4304 raft_consensus.cc:2229] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:44:08.111708 4300 raft_consensus.cc:2258] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:44:08.112066 4304 raft_consensus.cc:2258] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:44:08.114041 4300 ts_tablet_manager.cc:1905] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:08.114506 4304 ts_tablet_manager.cc:1905] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:08.121508 4304 ts_tablet_manager.cc:1918] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:44:08.121696 4304 log.cc:1196] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/69a918c3d54145858acf6a6fbf68f147
I20260806 10:44:08.122298 4304 ts_tablet_manager.cc:1939] T 69a918c3d54145858acf6a6fbf68f147 P 55165bfc3da249bba8b705815cf45076: Deleting consensus metadata
I20260806 10:44:08.122720 4300 ts_tablet_manager.cc:1918] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:44:08.122978 4300 log.cc:1196] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/69a918c3d54145858acf6a6fbf68f147
I20260806 10:44:08.123585 4300 ts_tablet_manager.cc:1939] T 69a918c3d54145858acf6a6fbf68f147 P da85573d32ef41c1bc928f064b446d20: Deleting consensus metadata
I20260806 10:44:08.124886 3519 catalog_manager.cc:4841] TS 55165bfc3da249bba8b705815cf45076 (127.16.45.65:45843): tablet 69a918c3d54145858acf6a6fbf68f147 (table test-table [id=43f015ef3bcb436eb8ab623b0c4454d6]) successfully deleted
I20260806 10:44:08.125484 3524 catalog_manager.cc:4841] TS da85573d32ef41c1bc928f064b446d20 (127.16.45.67:35527): tablet 69a918c3d54145858acf6a6fbf68f147 (table test-table [id=43f015ef3bcb436eb8ab623b0c4454d6]) successfully deleted
I20260806 10:44:08.127678 4302 tablet_replica.cc:330] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4: stopping tablet replica
I20260806 10:44:08.128156 4302 raft_consensus.cc:2229] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:44:08.128700 4302 raft_consensus.cc:2258] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:44:08.131049 4302 ts_tablet_manager.cc:1905] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:08.138470 4302 ts_tablet_manager.cc:1918] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:44:08.138669 4302 log.cc:1196] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/69a918c3d54145858acf6a6fbf68f147
I20260806 10:44:08.139271 4302 ts_tablet_manager.cc:1939] T 69a918c3d54145858acf6a6fbf68f147 P 03f99561b47447adad0ac7bc3750c2a4: Deleting consensus metadata
I20260806 10:44:08.141616 3520 catalog_manager.cc:4841] TS 03f99561b47447adad0ac7bc3750c2a4 (127.16.45.66:35363): tablet 69a918c3d54145858acf6a6fbf68f147 (table test-table [id=43f015ef3bcb436eb8ab623b0c4454d6]) successfully deleted
I20260806 10:44:08.145184 4255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:08.107740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39126 (local address 127.16.45.65:45843)
0806 10:44:08.107933 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:08.107939 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:08.126902 (+ 18963us) server_negotiation.cc:407] Connection header received
0806 10:44:08.127115 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:08.127121 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:08.127212 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:08.127320 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:08.130090 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:08.131340 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:08.133391 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:08.134037 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:08.134183 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:08.137691 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:08.137710 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:08.137741 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:08.137796 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:08.141903 (+ 4107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:08.142795 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:08.142806 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:08.142810 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:08.142996 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:08.143487 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:08.143493 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:08.143497 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:08.143960 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:08.144325 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:08.144604 (+ 279us) server_negotiation.cc:299] Negotiation successful
0806 10:44:08.144842 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 10:44:08.145975 3821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:08.255453 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 3594
I20260806 10:44:08.279565 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 3834
I20260806 10:44:08.295277 4252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:08.280488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46720 (local address 127.16.45.66:35363)
0806 10:44:08.280719 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:08.280726 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:08.280750 (+ 24us) server_negotiation.cc:407] Connection header received
0806 10:44:08.280829 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:08.280835 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:08.280930 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:08.281054 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:08.282395 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:08.283503 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:08.284863 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:08.285500 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:08.285639 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:08.288468 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:08.288491 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:08.288514 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:08.288561 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:08.292142 (+ 3581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:08.292902 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:08.292911 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:08.292913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:08.293062 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:08.293545 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:08.293551 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:08.293554 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:08.293960 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:08.294256 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:08.294682 (+ 426us) server_negotiation.cc:299] Negotiation successful
0806 10:44:08.294931 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 10:44:08.295969 4030 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:08.390597 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 3834
I20260806 10:44:08.418660 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 4046
I20260806 10:44:08.434597 4254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:08.419555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59972 (local address 127.16.45.67:35527)
0806 10:44:08.419812 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:08.419822 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:08.419846 (+ 24us) server_negotiation.cc:407] Connection header received
0806 10:44:08.419945 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:08.419951 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:08.420019 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:08.420112 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:08.421580 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:08.422548 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:08.424056 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:08.424568 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:08.424731 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:08.427679 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:08.427696 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:08.427713 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:08.427767 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:08.431313 (+ 3546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:08.432091 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:08.432101 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:08.432104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:08.432298 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:08.432741 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:08.432747 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:08.432751 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:08.433166 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:08.433528 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:08.433845 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 10:44:08.434080 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 10:44:08.435544 4220 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:08.559643 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 4046
I20260806 10:44:08.582666 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 3496
I20260806 10:44:08.583844 3583 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:08.696067 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 3496
I20260806 10:44:08.731037 16565 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 10:44:09.076649 16565 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 10:44:09.076885 16565 mini_ranger.cc:66] Stopping Ranger...
I20260806 10:44:09.423688 16565 mini_ranger.cc:68] Stopped Ranger
2026-08-06 10:44:09.423 UTC [2177] LOG: received smart shutdown request
2026-08-06 10:44:09.427 UTC [2177] LOG: background worker "logical replication launcher" (PID 2188) exited with exit code 1
2026-08-06 10:44:09.427 UTC [2181] LOG: shutting down
2026-08-06 10:44:09.576 UTC [2177] LOG: database system is shut down
2026-08-06T10:44:09Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (53152 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:44:09 dist-test-slave-fgb3 krb5kdc[4319](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:44:09 dist-test-slave-fgb3 krb5kdc[4319](info): set up 2 sockets
Aug 06 10:44:09 dist-test-slave-fgb3 krb5kdc[4319](info): commencing operation
krb5kdc: starting...
W20260806 10:44:10.873212 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.001s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:44:11 dist-test-slave-fgb3 krb5kdc[4319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:44:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:44:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:44:11.136322 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:33427
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:33427,127.16.45.125:35237,127.16.45.124:34891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:11.467051 4341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:11.467326 4341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:11.467435 4341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:11.474659 4341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:44:11.474762 4341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:11.474815 4341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:11.474872 4341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:44:11.474917 4341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:44:11.484758 4341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:33427,127.16.45.125:35237,127.16.45.124:34891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:33427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:11.486065 4341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:11.487351 4341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:11.498862 4347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:11.498976 4348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:11.498937 4351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:11.499930 4341 server_base.cc:1034] running on GCE node
I20260806 10:44:11.500726 4341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:11.502151 4341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:11.503352 4341 hybrid_clock.cc:648] HybridClock initialized: now 1786013051503316 us; error 65 us; skew 500 ppm
I20260806 10:44:11.503702 4341 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:11 dist-test-slave-fgb3 krb5kdc[4319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013051, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:11.506908 4341 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:44:11.508453 4341 webserver.cc:460] Webserver started at http://127.16.45.126:33999/ using document root <none> and password file <none>
I20260806 10:44:11.509135 4341 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:11.509253 4341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:11.509560 4341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:44:11.512593 4341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "f21f572fc76a410c801c05cd7678e167"
format_stamp: "Formatted at 2026-08-06 10:44:11 on dist-test-slave-fgb3"
server_key: "071c94487148ec5687af509973c721be"
server_key_iv: "e161b22439e73ec68ad9cb8ca90397b6"
server_key_version: "encryptionkey@0"
I20260806 10:44:11.513378 4341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "f21f572fc76a410c801c05cd7678e167"
format_stamp: "Formatted at 2026-08-06 10:44:11 on dist-test-slave-fgb3"
server_key: "071c94487148ec5687af509973c721be"
server_key_iv: "e161b22439e73ec68ad9cb8ca90397b6"
server_key_version: "encryptionkey@0"
I20260806 10:44:11.518462 4341 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260806 10:44:11.521804 4359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:11.523098 4341 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:44:11.523249 4341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "f21f572fc76a410c801c05cd7678e167"
format_stamp: "Formatted at 2026-08-06 10:44:11 on dist-test-slave-fgb3"
server_key: "071c94487148ec5687af509973c721be"
server_key_iv: "e161b22439e73ec68ad9cb8ca90397b6"
server_key_version: "encryptionkey@0"
I20260806 10:44:11.523430 4341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:11.536082 4341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:11.540310 4341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:11.540589 4341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:11.558185 4341 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:33427
I20260806 10:44:11.558215 4433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:33427 every 8 connection(s)
I20260806 10:44:11.559584 4341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:44:11.561321 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 4341
I20260806 10:44:11.561576 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:44:11.562424 16565 external_mini_cluster.cc:1428] Setting key 2d36be625b62c67cad857ab359ed0b94
I20260806 10:44:11.564121 4434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:11.572773 4434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:44:11 dist-test-slave-fgb3 krb5kdc[4319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013051, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.45.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.125@KRBTEST.COM" created.
I20260806 10:44:11.595293 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:11.576211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33427 (local address 127.0.0.1:60296)
0806 10:44:11.577307 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:11.577347 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:11.579118 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:11.579927 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:11.579934 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:11.580622 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:11.580957 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:11.580974 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:11.582513 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:11.582517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:11.583578 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:11.583590 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:11.584590 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:11.584598 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:11.584765 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:11.585442 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:11.585464 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:11.587614 (+ 2150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:11.591061 (+ 3447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:11.591072 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:11.591082 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:11.591507 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:11.591958 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:11.591962 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:11.591964 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:11.592118 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:11.593044 (+ 926us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:11.593051 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:11.593253 (+ 202us) client_negotiation.cc:769] Sending connection context
0806 10:44:11.593515 (+ 262us) client_negotiation.cc:240] Negotiation successful
0806 10:44:11.594130 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":900,"mutex_wait_us":154,"thread_start_us":709,"threads_started":1}
I20260806 10:44:11.595338 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:11.576205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60296 (local address 127.16.45.126:33427)
0806 10:44:11.577003 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:11.577018 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:11.577468 (+ 450us) server_negotiation.cc:407] Connection header received
0806 10:44:11.579471 (+ 2003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:11.579477 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:11.579698 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:11.579869 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:11.581144 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:11.582373 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:11.583710 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:11.584348 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:11.584528 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:11.587820 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:11.587829 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:11.587840 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:11.587871 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:11.590925 (+ 3054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:11.591643 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:11.591652 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:11.591655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:11.591842 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:11.592214 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:11.592219 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:11.592222 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:11.592877 (+ 655us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:11.593072 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:11.593659 (+ 587us) server_negotiation.cc:299] Negotiation successful
0806 10:44:11.593962 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":361,"threads_started":1}
I20260806 10:44:11.598750 4434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } has no permanent_uuid. Determining permanent_uuid...
I20260806 10:44:11.599854 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:11.599454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33202)
0806 10:44:11.599626 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:11.599736 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 10:44:11.600123 4361 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
I20260806 10:44:11.601817 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:11.601471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33206)
0806 10:44:11.601613 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:11.601679 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 10:44:11.602084 4434 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:35237: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.125.keytab.
Entry for principal kudu/127.16.45.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.125.keytab.
I20260806 10:44:11.622197 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.125:35237
--webserver_interface=127.16.45.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.125.keytab
--principal=kudu/127.16.45.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:33427,127.16.45.125:35237,127.16.45.124:34891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:44:11.651567 4434 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } attempt: 1
I20260806 10:44:11.652834 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:11.652300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33210)
0806 10:44:11.652518 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:11.652661 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 10:44:11.653894 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:11.653497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33222)
0806 10:44:11.653635 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:11.653722 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 10:44:11.654078 4434 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:35237: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
I20260806 10:44:11.722375 4434 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } attempt: 2
I20260806 10:44:11.723673 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:11.723101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33226)
0806 10:44:11.723378 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:11.723497 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 10:44:11.724673 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:11.724276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33228)
0806 10:44:11.724429 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:11.724515 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 10:44:11.724861 4434 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:35237: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
I20260806 10:44:11.816138 4434 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } attempt: 3
I20260806 10:44:11.817512 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:11.816925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33234)
0806 10:44:11.817175 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:11.817325 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260806 10:44:11.818718 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:11.818231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33246)
0806 10:44:11.818431 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:11.818529 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 10:44:11.818980 4434 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:35237: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
W20260806 10:44:11.953171 4446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:11.953467 4446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:11.953557 4446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:11.960753 4446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:44:11.960873 4446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:11.960929 4446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:11.960985 4446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:44:11.961030 4446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:44:11.962273 4434 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } attempt: 4
I20260806 10:44:11.963563 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:11.962948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33262)
0806 10:44:11.963286 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:11.963394 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184}
I20260806 10:44:11.964725 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:11.964319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33274)
0806 10:44:11.964470 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:11.964581 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 10:44:11.964977 4434 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:35237: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35237: connect: Connection refused (error 111)
I20260806 10:44:11.971602 4446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:33427,127.16.45.125:35237,127.16.45.124:34891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.125.keytab
--principal=kudu/127.16.45.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.125:35237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.16.45.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:11.972892 4446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:11.974174 4446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:11.985927 4452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:11.985993 4455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:11.986018 4462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:11.986940 4446 server_base.cc:1034] running on GCE node
I20260806 10:44:11.987758 4446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:11.989147 4446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:11.990381 4446 hybrid_clock.cc:648] HybridClock initialized: now 1786013051990322 us; error 48 us; skew 500 ppm
I20260806 10:44:11.990726 4446 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:11 dist-test-slave-fgb3 krb5kdc[4319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013051, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:11.993897 4446 init.cc:377] Logged in from keytab as kudu/127.16.45.125@KRBTEST.COM (short username kudu)
I20260806 10:44:11.995477 4446 webserver.cc:460] Webserver started at http://127.16.45.125:35713/ using document root <none> and password file <none>
I20260806 10:44:11.996167 4446 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:11.996287 4446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:11.996588 4446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:44:11.999605 4446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/data/instance:
uuid: "4e998e1a8806437fb1f741f9d2be44af"
format_stamp: "Formatted at 2026-08-06 10:44:11 on dist-test-slave-fgb3"
server_key: "159c506ce29e7b28764d3f20950ed158"
server_key_iv: "420d676374002f68d392d1f7cdc79017"
server_key_version: "encryptionkey@0"
I20260806 10:44:12.000408 4446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/wal/instance:
uuid: "4e998e1a8806437fb1f741f9d2be44af"
format_stamp: "Formatted at 2026-08-06 10:44:11 on dist-test-slave-fgb3"
server_key: "159c506ce29e7b28764d3f20950ed158"
server_key_iv: "420d676374002f68d392d1f7cdc79017"
server_key_version: "encryptionkey@0"
I20260806 10:44:12.005637 4446 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 10:44:12.009227 4470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:12.010772 4446 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:44:12.010949 4446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/wal
uuid: "4e998e1a8806437fb1f741f9d2be44af"
format_stamp: "Formatted at 2026-08-06 10:44:11 on dist-test-slave-fgb3"
server_key: "159c506ce29e7b28764d3f20950ed158"
server_key_iv: "420d676374002f68d392d1f7cdc79017"
server_key_version: "encryptionkey@0"
I20260806 10:44:12.011149 4446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:12.025049 4446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:12.029558 4446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:12.029831 4446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:12.047576 4446 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.125:35237
I20260806 10:44:12.047621 4540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.125:35237 every 8 connection(s)
I20260806 10:44:12.048962 4446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
I20260806 10:44:12.052601 4542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:12.057399 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 4446
I20260806 10:44:12.057590 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-1/wal/instance
I20260806 10:44:12.058017 16565 external_mini_cluster.cc:1428] Setting key 3fb67a46c8b451025c67150abf24fb72
I20260806 10:44:12.059729 4542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:44:12 dist-test-slave-fgb3 krb5kdc[4319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013051, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.125@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:12.079746 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.062368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60312 (local address 127.16.45.126:33427)
0806 10:44:12.062531 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.062536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.063979 (+ 1443us) server_negotiation.cc:407] Connection header received
0806 10:44:12.065832 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.065838 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.065919 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.066008 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.067529 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.068180 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.069664 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.070081 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.070190 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.073752 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.073758 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.073762 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.073797 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.076402 (+ 2605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.077316 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.077320 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.077323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.077470 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.077925 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.077930 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.077932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.078271 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.078460 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.079329 (+ 869us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.079526 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 10:44:12.081197 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.062999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33427 (local address 127.0.0.1:60312)
0806 10:44:12.063797 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.063843 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:12.065555 (+ 1712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:12.066248 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:12.066256 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:12.066801 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:12.067354 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.067370 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.068327 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.068331 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.069524 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.069536 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.070292 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.070300 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.070538 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.071162 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:12.071184 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:12.073512 (+ 2328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:12.076553 (+ 3041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.076562 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.076577 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.077176 (+ 599us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.077583 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.077588 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.077592 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.077827 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.078463 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:12.078472 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:12.078939 (+ 467us) client_negotiation.cc:769] Sending connection context
0806 10:44:12.079265 (+ 326us) client_negotiation.cc:240] Negotiation successful
0806 10:44:12.079806 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":356,"threads_started":1}
WARNING: no policy specified for kudu/127.16.45.124@KRBTEST.COM; defaulting to no policy
I20260806 10:44:12.082917 4542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.124@KRBTEST.COM" created.
Aug 06 10:44:12 dist-test-slave-fgb3 krb5kdc[4319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013051, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.125@KRBTEST.COM for kudu/127.16.45.125@KRBTEST.COM
I20260806 10:44:12.098735 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.083721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33278)
0806 10:44:12.083913 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.083935 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:12.084019 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:12.084973 (+ 954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:12.084977 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:12.085403 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:12.085587 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.085599 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.087478 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.087482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.088351 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.088362 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.089425 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.089430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.089569 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.090137 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:12.090154 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:12.092329 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:12.096006 (+ 3677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.096010 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.096013 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.096506 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.096918 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.096922 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.096926 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.097100 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.097745 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:12.097750 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:12.097892 (+ 142us) client_negotiation.cc:769] Sending connection context
0806 10:44:12.098045 (+ 153us) client_negotiation.cc:240] Negotiation successful
0806 10:44:12.098346 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260806 10:44:12.098764 4549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.083868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33278 (local address 127.16.45.125:35237)
0806 10:44:12.084532 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.084538 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.084563 (+ 25us) server_negotiation.cc:407] Connection header received
0806 10:44:12.084608 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.084615 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.084803 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.084930 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.085762 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.087329 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.088484 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.089223 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.089337 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.092549 (+ 3212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.092564 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.092581 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.092615 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.095878 (+ 3263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.096649 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.096656 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.096658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.096808 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.097229 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.097233 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.097235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.097613 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.097799 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.098156 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.098462 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":83,"server-negotiator.queue_time_us":504,"thread_start_us":360,"threads_started":1}
I20260806 10:44:12.101209 4542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } has no permanent_uuid. Determining permanent_uuid...
I20260806 10:44:12.102555 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.101945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33342)
0806 10:44:12.102133 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.102276 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260806 10:44:12.102847 4474 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
I20260806 10:44:12.104470 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.104091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33344)
0806 10:44:12.104242 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.104341 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 10:44:12.104733 4542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:34891: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.124.keytab.
Entry for principal kudu/127.16.45.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.124.keytab.
I20260806 10:44:12.119858 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.124:34891
--webserver_interface=127.16.45.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.124.keytab
--principal=kudu/127.16.45.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:33427,127.16.45.125:35237,127.16.45.124:34891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:44:12.154076 4542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } attempt: 1
I20260806 10:44:12.155354 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.154821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33346)
0806 10:44:12.155031 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.155157 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 10:44:12.156414 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.156021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33362)
0806 10:44:12.156182 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.156266 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 10:44:12.156632 4542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:34891: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
I20260806 10:44:12.224887 4542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } attempt: 2
I20260806 10:44:12.226186 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.225618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33364)
0806 10:44:12.225846 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.225962 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 10:44:12.227252 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.226866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33372)
0806 10:44:12.227014 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.227106 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 10:44:12.227517 4542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:34891: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
I20260806 10:44:12.264266 4434 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } attempt: 5
Aug 06 10:44:12 dist-test-slave-fgb3 krb5kdc[4319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013051, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for kudu/127.16.45.125@KRBTEST.COM
I20260806 10:44:12.277874 4549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.265168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33290 (local address 127.16.45.125:35237)
0806 10:44:12.265380 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.265385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.265407 (+ 22us) server_negotiation.cc:407] Connection header received
0806 10:44:12.265505 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.265509 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.265573 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.265655 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.266534 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.267227 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.268399 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.268851 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.268966 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.272460 (+ 3494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.272466 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.272470 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.272504 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.275048 (+ 2544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.275891 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.275904 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.275906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.276057 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.276470 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.276474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.276476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.276809 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.276934 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.277469 (+ 535us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.277654 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 10:44:12.278113 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.264995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33290)
0806 10:44:12.265196 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.265217 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:12.265361 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:12.265729 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:12.265734 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:12.266128 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:12.266371 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.266384 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.267374 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.267380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.268260 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.268273 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.269010 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.269016 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.269179 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.269827 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:12.269844 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:12.272184 (+ 2340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:12.275195 (+ 3011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.275201 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.275205 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.275740 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.276174 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.276179 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.276183 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.276352 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.276935 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:12.276941 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:12.277132 (+ 191us) client_negotiation.cc:769] Sending connection context
0806 10:44:12.277301 (+ 169us) client_negotiation.cc:240] Negotiation successful
0806 10:44:12.277715 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 10:44:12.279194 4434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } has no permanent_uuid. Determining permanent_uuid...
I20260806 10:44:12.280352 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.279896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33386)
0806 10:44:12.280084 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.280179 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 10:44:12.281391 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.281002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33400)
0806 10:44:12.281163 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.281256 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 10:44:12.281642 4434 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:34891: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
I20260806 10:44:12.318764 4542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } attempt: 3
I20260806 10:44:12.319979 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.319401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33414)
0806 10:44:12.319638 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.319765 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 10:44:12.321074 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.320645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33420)
0806 10:44:12.320874 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.320946 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
W20260806 10:44:12.321287 4542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:34891: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
I20260806 10:44:12.332890 4434 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } attempt: 1
I20260806 10:44:12.334074 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.333538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33422)
0806 10:44:12.333741 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.333871 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 10:44:12.335083 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.334725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33424)
0806 10:44:12.334871 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.334954 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 10:44:12.335343 4434 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:34891: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
I20260806 10:44:12.403586 4434 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } attempt: 2
I20260806 10:44:12.404831 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.404252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33440)
0806 10:44:12.404503 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.404615 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 10:44:12.405841 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.405459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33448)
0806 10:44:12.405607 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.405694 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 10:44:12.406054 4434 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:34891: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
W20260806 10:44:12.450994 4554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:12.451303 4554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:12.451442 4554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:12.458935 4554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:44:12.459050 4554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:12.459125 4554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:12.459213 4554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:44:12.459267 4554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:44:12.464543 4542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } attempt: 4
I20260806 10:44:12.465719 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.465235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33454)
0806 10:44:12.465473 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.465562 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 10:44:12.466691 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.466365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33470)
0806 10:44:12.466517 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.466587 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 10:44:12.466884 4542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:34891: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
I20260806 10:44:12.469941 4554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:33427,127.16.45.125:35237,127.16.45.124:34891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.124.keytab
--principal=kudu/127.16.45.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.124:34891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.16.45.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:12.471326 4554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:12.472707 4554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:12.484498 4562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:12.484462 4563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:12.484462 4565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:12.485371 4554 server_base.cc:1034] running on GCE node
I20260806 10:44:12.486119 4554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:12.487556 4554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:12.488772 4554 hybrid_clock.cc:648] HybridClock initialized: now 1786013052488709 us; error 55 us; skew 500 ppm
I20260806 10:44:12.489115 4554 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:12 dist-test-slave-fgb3 krb5kdc[4319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013052, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:12.492324 4554 init.cc:377] Logged in from keytab as kudu/127.16.45.124@KRBTEST.COM (short username kudu)
I20260806 10:44:12.493818 4554 webserver.cc:460] Webserver started at http://127.16.45.124:32909/ using document root <none> and password file <none>
I20260806 10:44:12.494525 4554 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:12.494647 4554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:12.494954 4554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:44:12.497817 4554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/data/instance:
uuid: "e2fad3ca039d410385aa69816e80212b"
format_stamp: "Formatted at 2026-08-06 10:44:12 on dist-test-slave-fgb3"
server_key: "1bd1f68a4ab883f015f3bd82ee7e06ef"
server_key_iv: "87a620dd327f35c154aaf522afec434f"
server_key_version: "encryptionkey@0"
I20260806 10:44:12.498672 4554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/wal/instance:
uuid: "e2fad3ca039d410385aa69816e80212b"
format_stamp: "Formatted at 2026-08-06 10:44:12 on dist-test-slave-fgb3"
server_key: "1bd1f68a4ab883f015f3bd82ee7e06ef"
server_key_iv: "87a620dd327f35c154aaf522afec434f"
server_key_version: "encryptionkey@0"
I20260806 10:44:12.503722 4554 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 10:44:12.507038 4574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:12.508354 4554 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:44:12.508549 4554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/wal
uuid: "e2fad3ca039d410385aa69816e80212b"
format_stamp: "Formatted at 2026-08-06 10:44:12 on dist-test-slave-fgb3"
server_key: "1bd1f68a4ab883f015f3bd82ee7e06ef"
server_key_iv: "87a620dd327f35c154aaf522afec434f"
server_key_version: "encryptionkey@0"
I20260806 10:44:12.508728 4554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:12.512279 4434 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } attempt: 3
I20260806 10:44:12.513428 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.512898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33486)
0806 10:44:12.513108 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.513215 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 10:44:12.514693 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.514203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33502)
0806 10:44:12.514434 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.514534 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260806 10:44:12.514957 4434 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:34891: Network error: Client connection negotiation failed: client connection to 127.16.45.124:34891: connect: Connection refused (error 111)
I20260806 10:44:12.531068 4554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:12.535455 4554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:12.535722 4554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:12.551882 4554 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.124:34891
I20260806 10:44:12.551904 4647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.124:34891 every 8 connection(s)
I20260806 10:44:12.553200 4554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
I20260806 10:44:12.555971 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 4554
I20260806 10:44:12.556169 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786012840862403-16565-0/minicluster-data/master-2/wal/instance
I20260806 10:44:12.556689 16565 external_mini_cluster.cc:1428] Setting key 31fbdca06092a9da3fd997a8c4542cc5
I20260806 10:44:12.557029 4650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:12.567443 4650 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:44:12 dist-test-slave-fgb3 krb5kdc[4319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013052, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.124@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
Aug 06 10:44:12 dist-test-slave-fgb3 krb5kdc[4319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.124@KRBTEST.COM
I20260806 10:44:12.586531 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.571169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60320 (local address 127.16.45.126:33427)
0806 10:44:12.571370 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.571376 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.572042 (+ 666us) server_negotiation.cc:407] Connection header received
0806 10:44:12.572619 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.572623 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.572692 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.572771 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.574144 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.574929 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.576584 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.577214 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.577309 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.580882 (+ 3573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.580889 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.580894 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.580933 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.583609 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.584329 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.584334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.584338 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.584472 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.584850 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.584854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.584856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.585110 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.585247 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.585910 (+ 663us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.586133 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 10:44:12.587611 4655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.558590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33512 (local address 127.16.45.124:34891)
0806 10:44:12.569271 (+ 10681us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.569290 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.569790 (+ 500us) server_negotiation.cc:407] Connection header received
0806 10:44:12.572359 (+ 2569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.572387 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.572678 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.572870 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.574220 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.575667 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.577229 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.578014 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.578145 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.582019 (+ 3874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.582027 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.582038 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.582067 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.584638 (+ 2571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.585298 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.585304 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.585307 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.585436 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.585776 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.585779 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.585781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.586118 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.586420 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.586760 (+ 340us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.586991 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":10393,"thread_start_us":10142,"threads_started":1}
I20260806 10:44:12.587646 4656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.571121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33427 (local address 127.0.0.1:60320)
0806 10:44:12.571876 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.571926 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:12.572372 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:12.572867 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:12.572874 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:12.573585 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:12.573967 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.573984 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.575082 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.575087 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.576446 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.576459 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.577445 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.577453 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.577776 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.578565 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:12.578586 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:12.580660 (+ 2074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:12.583731 (+ 3071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.583742 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.583754 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.584223 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.584575 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.584580 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.584584 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.584747 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.585242 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:12.585249 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:12.585566 (+ 317us) client_negotiation.cc:769] Sending connection context
0806 10:44:12.585800 (+ 234us) client_negotiation.cc:240] Negotiation successful
0806 10:44:12.586300 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"mutex_wait_us":46,"thread_start_us":312,"threads_started":1}
I20260806 10:44:12.589337 4650 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:44:12 dist-test-slave-fgb3 krb5kdc[4319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013052, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.124@KRBTEST.COM for kudu/127.16.45.125@KRBTEST.COM
Aug 06 10:44:12 dist-test-slave-fgb3 krb5kdc[4319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:12.603389 4656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.590072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35237 (local address 127.0.0.1:33300)
0806 10:44:12.590228 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.590246 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:12.590368 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:12.590916 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:12.590921 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:12.591345 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:12.591506 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.591514 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.592780 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.592786 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.593977 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.593990 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.594949 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.594953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.595174 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.595731 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:12.595753 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:12.597758 (+ 2005us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:12.601044 (+ 3286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.601050 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.601054 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.601548 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.601911 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.601916 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.601920 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.602086 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.602579 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:12.602584 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:12.602738 (+ 154us) client_negotiation.cc:769] Sending connection context
0806 10:44:12.602894 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 10:44:12.603149 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 10:44:12.603506 4549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.590435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33300 (local address 127.16.45.125:35237)
0806 10:44:12.590615 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.590620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.590638 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:44:12.590693 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.590698 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.590774 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.590865 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.591660 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.592641 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.594117 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.594804 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.594930 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.597944 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.597951 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.597956 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.598006 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.600909 (+ 2903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.601649 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.601652 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.601655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.601808 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.602178 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.602181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.602183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.602469 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.602574 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.602947 (+ 373us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.603139 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 10:44:12.604804 4650 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } has no permanent_uuid. Determining permanent_uuid...
I20260806 10:44:12.605690 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.590476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60334 (local address 127.16.45.126:33427)
0806 10:44:12.590640 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.590645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.590792 (+ 147us) server_negotiation.cc:407] Connection header received
0806 10:44:12.590960 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.590965 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.591036 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.591136 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.592491 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.593497 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.595053 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.595598 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.595717 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.599920 (+ 4203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.599925 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.599928 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.599957 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.602964 (+ 3007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.603873 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.603877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.603879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.603998 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.604366 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.604370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.604372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.604673 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.604953 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.605180 (+ 227us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.605388 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
Aug 06 10:44:12 dist-test-slave-fgb3 krb5kdc[4319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013052, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.124@KRBTEST.COM for kudu/127.16.45.124@KRBTEST.COM
Aug 06 10:44:12 dist-test-slave-fgb3 krb5kdc[4319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.125@KRBTEST.COM
I20260806 10:44:12.617393 4656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.605615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33526)
0806 10:44:12.605845 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.605860 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:12.605954 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:12.606251 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:12.606254 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:12.606674 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:12.606832 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.606843 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.607890 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.607894 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.608729 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.608739 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.609414 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.609419 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.609623 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.610143 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:12.610159 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:12.612210 (+ 2051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:12.615143 (+ 2933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.615149 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.615153 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.615589 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.615959 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.615962 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.615964 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.616108 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.616661 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:12.616664 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:12.616790 (+ 126us) client_negotiation.cc:769] Sending connection context
0806 10:44:12.616907 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 10:44:12.617093 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260806 10:44:12.617596 4655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.605616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33526 (local address 127.16.45.124:34891)
0806 10:44:12.605787 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.605792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.605914 (+ 122us) server_negotiation.cc:407] Connection header received
0806 10:44:12.606053 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.606057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.606122 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.606211 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.606957 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.607770 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.608857 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.609275 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.609361 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.612400 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.612405 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.612408 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.612435 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.615005 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.615684 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.615689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.615693 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.615842 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.616203 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.616208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.616211 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.616548 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.616692 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.617020 (+ 328us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.617224 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 10:44:12.621910 4549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.607296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33304 (local address 127.16.45.125:35237)
0806 10:44:12.607442 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.607447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.607507 (+ 60us) server_negotiation.cc:407] Connection header received
0806 10:44:12.607646 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.607650 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.607697 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.607763 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.608914 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.609727 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.611113 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.611507 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.611620 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.615661 (+ 4041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.615667 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.615671 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.615706 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.618914 (+ 3208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.619644 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.619647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.619650 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.619767 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.620184 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.620189 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.620191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.620505 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.620785 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.621300 (+ 515us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.621526 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 10:44:12.622880 4650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b: Bootstrap starting.
I20260806 10:44:12.626545 4650 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:12.626782 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:44:12.627821 4650 log.cc:824] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:12.630882 4650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b: No bootstrap required, opened a new log
I20260806 10:44:12.643436 4650 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } }
I20260806 10:44:12.643936 4650 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:12.644073 4650 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2fad3ca039d410385aa69816e80212b, State: Initialized, Role: FOLLOWER
I20260806 10:44:12.646970 4650 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } }
I20260806 10:44:12.655886 4650 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:44:12.656407 4668 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } } }
I20260806 10:44:12.657990 4668 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:44:12.664259 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.632245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60338 (local address 127.16.45.126:33427)
0806 10:44:12.632419 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.632425 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.645235 (+ 12810us) server_negotiation.cc:407] Connection header received
0806 10:44:12.645468 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.645475 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.645570 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.645666 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.648448 (+ 2782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.649649 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.652062 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.652744 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.652844 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.657386 (+ 4542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.657392 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.657397 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.657436 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.660880 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.661687 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.661692 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.661696 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.661870 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.662349 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.662354 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.662357 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.662757 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.663001 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.663834 (+ 833us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.664009 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 10:44:12.666366 4549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.632646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33308 (local address 127.16.45.125:35237)
0806 10:44:12.632806 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.632811 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.645993 (+ 13182us) server_negotiation.cc:407] Connection header received
0806 10:44:12.646158 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.646164 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.646254 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.646397 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.648839 (+ 2442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.649900 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.652227 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.652908 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.653049 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.657291 (+ 4242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.657298 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.657304 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.657346 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.662111 (+ 4765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.663434 (+ 1323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.663439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.663444 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.663599 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.664039 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.664044 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.664048 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.664437 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.665553 (+ 1116us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.665720 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.665967 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 10:44:12.667989 4655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.633294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33532 (local address 127.16.45.124:34891)
0806 10:44:12.633484 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.633489 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.646831 (+ 13342us) server_negotiation.cc:407] Connection header received
0806 10:44:12.647140 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.647146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.647244 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.647324 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.649754 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.650886 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.653124 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.653881 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.653986 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.658100 (+ 4114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.658107 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.658112 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.658149 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.662267 (+ 4118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.665456 (+ 3189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.665462 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.665465 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.665665 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.666161 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.666167 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.666169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.666615 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.666870 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.667437 (+ 567us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.667623 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260806 10:44:12.672358 4681 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 10:44:12.672467 4681 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 10:44:12.669785 4554 master_runner.cc:186] Error getting master registration for 127.16.45.126:33427: OK, instance_id { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" instance_seqno: 1786013051553262 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 10:44:12.679515 4554 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 10:44:12.692190 4434 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } attempt: 4
Aug 06 10:44:12 dist-test-slave-fgb3 krb5kdc[4319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013051, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for kudu/127.16.45.124@KRBTEST.COM
I20260806 10:44:12.706337 4439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.692851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33548)
0806 10:44:12.693050 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.693069 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:12.693193 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:12.693537 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:12.693542 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:12.694074 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:12.694290 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.694304 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.695958 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.695964 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.696898 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.696910 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.697715 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.697721 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.697896 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.698496 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:12.698513 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:12.700533 (+ 2020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:12.704024 (+ 3491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.704029 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.704033 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.704392 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.704754 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.704759 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.704762 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.704888 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.705378 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:12.705383 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:12.705541 (+ 158us) client_negotiation.cc:769] Sending connection context
0806 10:44:12.705657 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 10:44:12.705928 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 10:44:12.706375 4655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.692880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33548 (local address 127.16.45.124:34891)
0806 10:44:12.693059 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.693065 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.693130 (+ 65us) server_negotiation.cc:407] Connection header received
0806 10:44:12.693337 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.693341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.693405 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.693493 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.695000 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.695822 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.697034 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.697559 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.697670 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.700752 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.700758 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.700763 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.700805 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.703894 (+ 3089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.704504 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.704509 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.704512 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.704651 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.704989 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.704992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.704994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.705264 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.705406 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.705779 (+ 373us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.706013 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 10:44:12.711146 4434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167: Bootstrap starting.
I20260806 10:44:12.714795 4434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:12.715965 4434 log.cc:824] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:12.718603 4434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167: No bootstrap required, opened a new log
I20260806 10:44:12.726460 4434 raft_consensus.cc:348] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } }
I20260806 10:44:12.726773 4434 raft_consensus.cc:374] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:12.726922 4434 raft_consensus.cc:729] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f21f572fc76a410c801c05cd7678e167, State: Initialized, Role: FOLLOWER
I20260806 10:44:12.727440 4434 consensus_queue.cc:260] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } }
I20260806 10:44:12.728320 4684 sys_catalog.cc:455] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } } }
I20260806 10:44:12.728754 4684 sys_catalog.cc:458] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:44:12.729482 4434 sys_catalog.cc:564] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 10:44:12.738443 4704 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 10:44:12.738644 4704 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 10:44:12.740515 4341 master_runner.cc:186] Error getting master registration for 127.16.45.125:35237: OK, instance_id { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" instance_seqno: 1786013052042490 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 10:44:12.751266 4341 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 10:44:12.766077 4542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } attempt: 5
Aug 06 10:44:12 dist-test-slave-fgb3 krb5kdc[4319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013051, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.125@KRBTEST.COM for kudu/127.16.45.124@KRBTEST.COM
I20260806 10:44:12.783550 4546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.766745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:34891 (local address 127.0.0.1:33556)
0806 10:44:12.767102 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:12.767123 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:12.767228 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:12.768087 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:12.768093 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:12.768621 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:12.768865 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.768878 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.770308 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.770343 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.771738 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:12.771753 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.772760 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.772766 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:12.773000 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.773679 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:12.773702 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:12.776476 (+ 2774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:12.780605 (+ 4129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.780610 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.780614 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.781142 (+ 528us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.781578 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:12.781583 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:12.781586 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:12.781744 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:12.782528 (+ 784us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:12.782533 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:12.782695 (+ 162us) client_negotiation.cc:769] Sending connection context
0806 10:44:12.782874 (+ 179us) client_negotiation.cc:240] Negotiation successful
0806 10:44:12.783169 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232}
I20260806 10:44:12.783684 4655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:12.767475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33556 (local address 127.16.45.124:34891)
0806 10:44:12.767767 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:12.767773 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:12.767791 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:44:12.767843 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:12.767849 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:12.767918 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:12.768028 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:12.769031 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.770151 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.771911 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:12.772605 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:12.772734 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:12.776680 (+ 3946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:12.776688 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:12.776692 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:12.776741 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:12.780438 (+ 3697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.781290 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.781296 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.781300 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.781450 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:12.781899 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:12.781904 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:12.781908 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:12.782303 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:12.782465 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:12.783035 (+ 570us) server_negotiation.cc:299] Negotiation successful
0806 10:44:12.783283 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171}
W20260806 10:44:12.787740 4582 tablet.cc:2369] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:12.789567 4542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af: Bootstrap starting.
W20260806 10:44:12.793430 4370 tablet.cc:2369] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:12.793685 4542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:12.795037 4542 log.cc:824] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:12.798923 4542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af: No bootstrap required, opened a new log
I20260806 10:44:12.809749 4542 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } }
I20260806 10:44:12.810179 4542 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:12.810297 4542 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e998e1a8806437fb1f741f9d2be44af, State: Initialized, Role: FOLLOWER
I20260806 10:44:12.811009 4542 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } }
I20260806 10:44:12.812005 4707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } } }
I20260806 10:44:12.812528 4707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:44:12.813472 4542 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:44:12.832274 4446 master_runner.cc:263] No leader master found from master 4e998e1a8806437fb1f741f9d2be44af
I20260806 10:44:12.832441 4446 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 10:44:12.836866 4721 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 10:44:12.837114 4721 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 10:44:12.998930 4668 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:44:12.999287 4668 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } }
I20260806 10:44:13.000957 4668 leader_election.cc:288] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f21f572fc76a410c801c05cd7678e167 (127.16.45.126:33427), 4e998e1a8806437fb1f741f9d2be44af (127.16.45.125:35237)
I20260806 10:44:13.002573 4502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2fad3ca039d410385aa69816e80212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e998e1a8806437fb1f741f9d2be44af" is_pre_election: true
I20260806 10:44:13.003224 4502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2fad3ca039d410385aa69816e80212b in term 0.
I20260806 10:44:13.004177 4396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2fad3ca039d410385aa69816e80212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f21f572fc76a410c801c05cd7678e167" is_pre_election: true
I20260806 10:44:13.004776 4396 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2fad3ca039d410385aa69816e80212b in term 0.
I20260806 10:44:13.005677 4579 leader_election.cc:302] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2fad3ca039d410385aa69816e80212b, f21f572fc76a410c801c05cd7678e167; no voters:
I20260806 10:44:13.006830 4668 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:44:13.006999 4668 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:44:13.007110 4668 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:13.010857 4668 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } }
I20260806 10:44:13.012454 4396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2fad3ca039d410385aa69816e80212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f21f572fc76a410c801c05cd7678e167"
I20260806 10:44:13.012735 4396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:13.017277 4396 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fad3ca039d410385aa69816e80212b in term 1.
I20260806 10:44:13.022301 4579 leader_election.cc:302] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2fad3ca039d410385aa69816e80212b, f21f572fc76a410c801c05cd7678e167; no voters:
I20260806 10:44:13.025731 4502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e2fad3ca039d410385aa69816e80212b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e998e1a8806437fb1f741f9d2be44af"
I20260806 10:44:13.025988 4502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:13.029762 4502 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2fad3ca039d410385aa69816e80212b in term 1.
I20260806 10:44:13.030838 4668 leader_election.cc:288] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [CANDIDATE]: Term 1 election: Requested vote from peers f21f572fc76a410c801c05cd7678e167 (127.16.45.126:33427), 4e998e1a8806437fb1f741f9d2be44af (127.16.45.125:35237)
I20260806 10:44:13.031198 4668 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:44:13.031428 4668 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [term 1 LEADER]: Becoming Leader. State: Replica: e2fad3ca039d410385aa69816e80212b, State: Running, Role: LEADER
I20260806 10:44:13.032048 4668 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } }
W20260806 10:44:13.032420 4476 tablet.cc:2369] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:13.040218 4723 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2fad3ca039d410385aa69816e80212b. Latest consensus state: current_term: 1 leader_uuid: "e2fad3ca039d410385aa69816e80212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } } }
I20260806 10:44:13.040752 4723 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:13.046010 4726 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:44:13.075748 4726 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:44:13.092120 4502 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [term 1 FOLLOWER]: Refusing update from remote peer e2fad3ca039d410385aa69816e80212b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:44:13.093343 4723 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:44:13.099424 4396 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [term 1 FOLLOWER]: Refusing update from remote peer e2fad3ca039d410385aa69816e80212b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:44:13.100556 4723 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:44:13.103396 4707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2fad3ca039d410385aa69816e80212b. Latest consensus state: current_term: 1 leader_uuid: "e2fad3ca039d410385aa69816e80212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } } }
I20260806 10:44:13.103693 4707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:44:13.105695 4727 mvcc.cc:205] Tried to move back new op lower bound from 7315509465451466752 to 7315509465224978432. Current Snapshot: MvccSnapshot[applied={T|T < 7315509465451466752}]
I20260806 10:44:13.115150 4668 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e2fad3ca039d410385aa69816e80212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } } }
I20260806 10:44:13.115471 4668 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:13.122017 4707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e2fad3ca039d410385aa69816e80212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } } }
I20260806 10:44:13.122272 4707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:44:13.125790 4684 sys_catalog.cc:455] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2fad3ca039d410385aa69816e80212b. Latest consensus state: current_term: 1 leader_uuid: "e2fad3ca039d410385aa69816e80212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } } }
I20260806 10:44:13.126132 4684 sys_catalog.cc:458] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:44:13.128248 4726 catalog_manager.cc:1347] Generated new cluster ID: 9bbb7a096fbe418397ca161bee6e5c25
I20260806 10:44:13.128360 4726 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:44:13.148629 4723 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e2fad3ca039d410385aa69816e80212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } } }
I20260806 10:44:13.148944 4723 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:13.166535 4726 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:44:13.169106 4726 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:44:13.169800 4684 sys_catalog.cc:455] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e2fad3ca039d410385aa69816e80212b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f572fc76a410c801c05cd7678e167" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33427 } } peers { permanent_uuid: "4e998e1a8806437fb1f741f9d2be44af" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35237 } } peers { permanent_uuid: "e2fad3ca039d410385aa69816e80212b" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 34891 } } }
I20260806 10:44:13.170049 4684 sys_catalog.cc:458] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:44:13.187685 4726 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b: Generated new TSK 0
I20260806 10:44:13.188910 4726 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:44:13.740722 4704 catalog_manager.cc:1259] Loaded cluster ID: 9bbb7a096fbe418397ca161bee6e5c25
I20260806 10:44:13.740833 4704 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167: loading cluster ID for follower catalog manager: success
I20260806 10:44:13.743310 4704 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167: acquiring CA information for follower catalog manager: success
I20260806 10:44:13.745056 4704 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f21f572fc76a410c801c05cd7678e167: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 10:44:13.839272 4721 catalog_manager.cc:1259] Loaded cluster ID: 9bbb7a096fbe418397ca161bee6e5c25
I20260806 10:44:13.839381 4721 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af: loading cluster ID for follower catalog manager: success
I20260806 10:44:13.841805 4721 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af: acquiring CA information for follower catalog manager: success
I20260806 10:44:13.843613 4721 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4e998e1a8806437fb1f741f9d2be44af: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 10:44:14.279434 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 4341
I20260806 10:44:14.281210 4424 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:14.389310 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 4341
I20260806 10:44:14.414300 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 4446
I20260806 10:44:14.415565 4535 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:14.519338 4751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:14.518525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33427 (local address 127.0.0.1:35728)
0806 10:44:14.519033 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:14.519162 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:33427: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":266,"threads_started":1}
W20260806 10:44:14.519649 4579 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.45.126:33427: connect: Connection refused (error 111)
I20260806 10:44:14.521072 4751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:14.520717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33427 (local address 127.0.0.1:35736)
0806 10:44:14.520871 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:14.520960 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:33427: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260806 10:44:14.521256 4579 consensus_peers.cc:487] T 00000000000000000000000000000000 P e2fad3ca039d410385aa69816e80212b -> Peer f21f572fc76a410c801c05cd7678e167 (127.16.45.126:33427): Couldn't send request to peer f21f572fc76a410c801c05cd7678e167. Status: Network error: Client connection negotiation failed: client connection to 127.16.45.126:33427: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 10:44:14.523321 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 4446
I20260806 10:44:14.547006 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 4554
I20260806 10:44:14.548226 4640 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:14.655112 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 4554
2026-08-06T10:44:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4966 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:44:14 dist-test-slave-fgb3 krb5kdc[4759](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:44:14 dist-test-slave-fgb3 krb5kdc[4759](info): set up 2 sockets
Aug 06 10:44:14 dist-test-slave-fgb3 krb5kdc[4759](info): commencing operation
krb5kdc: starting...
W20260806 10:44:15.862793 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:44:16 dist-test-slave-fgb3 krb5kdc[4759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:44:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:44:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:44:16.137823 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:39177
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:39177
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:16.546777 4773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:16.547096 4773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:16.547256 4773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:16.554772 4773 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:44:16.554901 4773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:16.554988 4773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:16.555074 4773 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:44:16.555142 4773 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:44:16.565567 4773 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:39177
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:39177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:16.566984 4773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:16.568383 4773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:16.580358 4778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:16.580390 4780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:16.580900 4782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:16.581138 4773 server_base.cc:1034] running on GCE node
I20260806 10:44:16.581867 4773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:16.583230 4773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:16.584425 4773 hybrid_clock.cc:648] HybridClock initialized: now 1786013056584380 us; error 30 us; skew 500 ppm
I20260806 10:44:16.584751 4773 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:16 dist-test-slave-fgb3 krb5kdc[4759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013056, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:16.587769 4773 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:44:16.589192 4773 webserver.cc:460] Webserver started at http://127.16.45.126:43503/ using document root <none> and password file <none>
I20260806 10:44:16.589830 4773 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:16.589954 4773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:16.590270 4773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:44:16.593200 4773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "1891293c11e24f40a54a75737b775e27"
format_stamp: "Formatted at 2026-08-06 10:44:16 on dist-test-slave-fgb3"
server_key: "d80c886ca79544b8bede53639ea65bd2"
server_key_iv: "43a5121aa491040ffb14ebfb64835d81"
server_key_version: "encryptionkey@0"
I20260806 10:44:16.593928 4773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "1891293c11e24f40a54a75737b775e27"
format_stamp: "Formatted at 2026-08-06 10:44:16 on dist-test-slave-fgb3"
server_key: "d80c886ca79544b8bede53639ea65bd2"
server_key_iv: "43a5121aa491040ffb14ebfb64835d81"
server_key_version: "encryptionkey@0"
I20260806 10:44:16.599000 4773 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 10:44:16.602675 4792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:16.604043 4773 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260806 10:44:16.604209 4773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "1891293c11e24f40a54a75737b775e27"
format_stamp: "Formatted at 2026-08-06 10:44:16 on dist-test-slave-fgb3"
server_key: "d80c886ca79544b8bede53639ea65bd2"
server_key_iv: "43a5121aa491040ffb14ebfb64835d81"
server_key_version: "encryptionkey@0"
I20260806 10:44:16.604424 4773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:16.615629 4773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:16.619704 4773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:16.619961 4773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:16.638177 4773 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:39177
I20260806 10:44:16.638182 4865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:39177 every 8 connection(s)
I20260806 10:44:16.639657 4773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:44:16.641417 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 4773
I20260806 10:44:16.641628 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:44:16.642254 16565 external_mini_cluster.cc:1428] Setting key f226a2468dbf6e9294f47949b48c71f8
I20260806 10:44:16.643833 4867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 10:44:16 dist-test-slave-fgb3 krb5kdc[4759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013056, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:16.657648 4867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27: Bootstrap starting.
I20260806 10:44:16.660876 4867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:16.661931 4867 log.cc:824] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:16.664857 4867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27: No bootstrap required, opened a new log
I20260806 10:44:16.665838 4872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:16.644112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58422 (local address 127.16.45.126:39177)
0806 10:44:16.644892 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:16.644904 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:16.644946 (+ 42us) server_negotiation.cc:407] Connection header received
0806 10:44:16.646794 (+ 1848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:16.646817 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:16.647213 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:16.647573 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:16.649489 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:16.650939 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:16.652708 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:16.653385 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:16.653516 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:16.658547 (+ 5031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:16.658556 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:16.658571 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:16.658609 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:16.661633 (+ 3024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:16.662451 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:16.662458 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:16.662464 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:16.662663 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:16.663082 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:16.663086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:16.663088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:16.663627 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:16.663888 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:16.664391 (+ 503us) server_negotiation.cc:299] Negotiation successful
0806 10:44:16.664805 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":331,"threads_started":1}
I20260806 10:44:16.669711 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:44:16.672863 4867 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1891293c11e24f40a54a75737b775e27" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39177 } }
I20260806 10:44:16.673259 4867 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:16.673348 4867 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1891293c11e24f40a54a75737b775e27, State: Initialized, Role: FOLLOWER
I20260806 10:44:16.673872 4867 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1891293c11e24f40a54a75737b775e27" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39177 } }
I20260806 10:44:16.674104 4867 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:44:16.674228 4867 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:44:16.674400 4867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:16.676568 4867 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1891293c11e24f40a54a75737b775e27" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39177 } }
I20260806 10:44:16.677048 4867 leader_election.cc:302] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1891293c11e24f40a54a75737b775e27; no voters:
I20260806 10:44:16.677608 4867 leader_election.cc:288] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:44:16.677728 4874 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:44:16.678438 4874 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [term 1 LEADER]: Becoming Leader. State: Replica: 1891293c11e24f40a54a75737b775e27, State: Running, Role: LEADER
I20260806 10:44:16.678946 4874 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1891293c11e24f40a54a75737b775e27" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39177 } }
I20260806 10:44:16.679705 4867 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:44:16.681602 4875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1891293c11e24f40a54a75737b775e27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1891293c11e24f40a54a75737b775e27" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39177 } } }
I20260806 10:44:16.682008 4875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:16.683066 4876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1891293c11e24f40a54a75737b775e27. Latest consensus state: current_term: 1 leader_uuid: "1891293c11e24f40a54a75737b775e27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1891293c11e24f40a54a75737b775e27" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39177 } } }
I20260806 10:44:16.683386 4876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27 [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:16.683749 4888 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:44:16.688697 4888 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:44:16.700374 4888 catalog_manager.cc:1347] Generated new cluster ID: 3fd47a0a59aa4edda7a9ecd4c3b19687
I20260806 10:44:16.700516 4888 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:44:16.717125 4888 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:44:16.718593 4888 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:44:16.734122 4888 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1891293c11e24f40a54a75737b775e27: Generated new TSK 0
I20260806 10:44:16.735033 4888 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:44:16.782187 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 4773
I20260806 10:44:16.783443 4861 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:16.881080 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 4773
2026-08-06T10:44:16Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2223 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:44:16 dist-test-slave-fgb3 krb5kdc[4915](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:44:16 dist-test-slave-fgb3 krb5kdc[4915](info): set up 2 sockets
Aug 06 10:44:16 dist-test-slave-fgb3 krb5kdc[4915](info): commencing operation
krb5kdc: starting...
W20260806 10:44:18.067107 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:44:18 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:44:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:44:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:44:18.346028 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40301
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:40301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:18.680691 4928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:18.681012 4928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:18.681149 4928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:18.688577 4928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:44:18.688700 4928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:18.688782 4928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:18.688861 4928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:44:18.688921 4928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:44:18.699231 4928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:40301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:18.701006 4928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:18.702596 4928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:18.714138 4939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:18.714155 4934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:18.714166 4936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:18.720037 4928 server_base.cc:1034] running on GCE node
I20260806 10:44:18.720877 4928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:18.722503 4928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:18.723723 4928 hybrid_clock.cc:648] HybridClock initialized: now 1786013058723660 us; error 54 us; skew 500 ppm
I20260806 10:44:18.724084 4928 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:18 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013058, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:18.727187 4928 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:44:18.728654 4928 webserver.cc:460] Webserver started at http://127.16.45.126:40827/ using document root <none> and password file <none>
I20260806 10:44:18.729365 4928 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:18.729485 4928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:18.729774 4928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:44:18.732806 4928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "d57c9922853b447ba0ae398aff1cbc49"
format_stamp: "Formatted at 2026-08-06 10:44:18 on dist-test-slave-fgb3"
server_key: "a0fefc0237f40f46e284ab82c778a2c2"
server_key_iv: "fb59a00646a0c6befd42cc324840ec9e"
server_key_version: "encryptionkey@0"
I20260806 10:44:18.733568 4928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "d57c9922853b447ba0ae398aff1cbc49"
format_stamp: "Formatted at 2026-08-06 10:44:18 on dist-test-slave-fgb3"
server_key: "a0fefc0237f40f46e284ab82c778a2c2"
server_key_iv: "fb59a00646a0c6befd42cc324840ec9e"
server_key_version: "encryptionkey@0"
I20260806 10:44:18.738910 4928 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260806 10:44:18.742295 4951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:18.743673 4928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:44:18.743857 4928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "d57c9922853b447ba0ae398aff1cbc49"
format_stamp: "Formatted at 2026-08-06 10:44:18 on dist-test-slave-fgb3"
server_key: "a0fefc0237f40f46e284ab82c778a2c2"
server_key_iv: "fb59a00646a0c6befd42cc324840ec9e"
server_key_version: "encryptionkey@0"
I20260806 10:44:18.744038 4928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:18.755009 4928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:18.758947 4928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:18.759217 4928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:18.776921 4928 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:40301
I20260806 10:44:18.776968 5015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:40301 every 8 connection(s)
I20260806 10:44:18.778292 4928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:44:18.781940 5016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:18.782701 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 4928
I20260806 10:44:18.782961 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:44:18.783813 16565 external_mini_cluster.cc:1428] Setting key 8ad4d6281dde256cc8ae81a8ed5288e8
I20260806 10:44:18.795837 5016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Bootstrap starting.
Aug 06 10:44:18 dist-test-slave-fgb3 krb5kdc[4915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:18.799615 5016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:18.800649 5016 log.cc:824] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:18.803799 5016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: No bootstrap required, opened a new log
I20260806 10:44:18.807251 5021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:18.785911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50308 (local address 127.16.45.126:40301)
0806 10:44:18.786743 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:18.786754 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:18.786796 (+ 42us) server_negotiation.cc:407] Connection header received
0806 10:44:18.788390 (+ 1594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:18.788412 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:18.788792 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:18.789100 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:18.790767 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:18.792013 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:18.793838 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:18.794535 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:18.794654 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:18.799529 (+ 4875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:18.799537 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:18.799550 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:18.799586 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:18.802928 (+ 3342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:18.803574 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:18.803583 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:18.803590 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:18.803817 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:18.804179 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:18.804184 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:18.804187 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:18.804874 (+ 687us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:18.805184 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:18.805466 (+ 282us) server_negotiation.cc:299] Negotiation successful
0806 10:44:18.805912 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":372,"threads_started":1}
I20260806 10:44:18.812319 5016 raft_consensus.cc:348] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } }
I20260806 10:44:18.812747 5016 raft_consensus.cc:374] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:18.812853 5016 raft_consensus.cc:729] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d57c9922853b447ba0ae398aff1cbc49, State: Initialized, Role: FOLLOWER
I20260806 10:44:18.813441 5016 consensus_queue.cc:260] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } }
I20260806 10:44:18.813657 5016 raft_consensus.cc:388] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:44:18.813750 5016 raft_consensus.cc:482] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:44:18.813868 5016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:18.815930 5016 raft_consensus.cc:504] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } }
I20260806 10:44:18.816341 5016 leader_election.cc:302] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d57c9922853b447ba0ae398aff1cbc49; no voters:
I20260806 10:44:18.816908 5016 leader_election.cc:288] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:44:18.816999 5023 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:44:18.817664 5023 raft_consensus.cc:686] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 1 LEADER]: Becoming Leader. State: Replica: d57c9922853b447ba0ae398aff1cbc49, State: Running, Role: LEADER
I20260806 10:44:18.818145 5023 consensus_queue.cc:237] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } }
I20260806 10:44:18.818943 5016 sys_catalog.cc:564] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:44:18.825071 5045 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 10:44:18.824793 5025 sys_catalog.cc:455] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d57c9922853b447ba0ae398aff1cbc49. Latest consensus state: current_term: 1 leader_uuid: "d57c9922853b447ba0ae398aff1cbc49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } } }
I20260806 10:44:18.825641 5025 sys_catalog.cc:458] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:18.824977 5024 sys_catalog.cc:455] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d57c9922853b447ba0ae398aff1cbc49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } } }
I20260806 10:44:18.825992 5024 sys_catalog.cc:458] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:18.827227 5046 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:44:18.831231 5046 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:44:18.839473 5046 catalog_manager.cc:1347] Generated new cluster ID: 8aab229fa6cd49fa937c0283ed4263ac
I20260806 10:44:18.839587 5046 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:44:18.850682 5046 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:44:18.852214 5046 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:44:18.859539 5046 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Generated new TSK 0
I20260806 10:44:18.860343 5046 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:44:18.922286 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:40301
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:19.261389 5055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:19.261659 5055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:19.261785 5055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:19.270848 5055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:19.270995 5055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:19.271190 5055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:44:19.283175 5055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:40301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:19.284498 5055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:19.285888 5055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:19.299822 5069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:19.300776 5070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:19.301175 5073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:19.301981 5055 server_base.cc:1034] running on GCE node
I20260806 10:44:19.302652 5055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:19.303535 5055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:19.304730 5055 hybrid_clock.cc:648] HybridClock initialized: now 1786013059304658 us; error 67 us; skew 500 ppm
I20260806 10:44:19.305069 5055 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:19 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013059, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:19.308908 5055 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:44:19.310767 5055 webserver.cc:460] Webserver started at http://127.16.45.65:43395/ using document root <none> and password file <none>
I20260806 10:44:19.311609 5055 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:19.311729 5055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:19.312047 5055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:44:19.314978 5055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "1505955c02a7476a8a5ed8f60ebb1d9e"
format_stamp: "Formatted at 2026-08-06 10:44:19 on dist-test-slave-fgb3"
server_key: "c9d25c781753fac692e3b12c28818032"
server_key_iv: "55842fda7b659df5572f03910567df92"
server_key_version: "encryptionkey@0"
I20260806 10:44:19.315954 5055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "1505955c02a7476a8a5ed8f60ebb1d9e"
format_stamp: "Formatted at 2026-08-06 10:44:19 on dist-test-slave-fgb3"
server_key: "c9d25c781753fac692e3b12c28818032"
server_key_iv: "55842fda7b659df5572f03910567df92"
server_key_version: "encryptionkey@0"
I20260806 10:44:19.322064 5055 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 10:44:19.325485 5083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:19.326864 5055 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:44:19.327013 5055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "1505955c02a7476a8a5ed8f60ebb1d9e"
format_stamp: "Formatted at 2026-08-06 10:44:19 on dist-test-slave-fgb3"
server_key: "c9d25c781753fac692e3b12c28818032"
server_key_iv: "55842fda7b659df5572f03910567df92"
server_key_version: "encryptionkey@0"
I20260806 10:44:19.327178 5055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:19.347661 5055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:19.351706 5055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:19.351950 5055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:19.352869 5055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:19.354126 5055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:19.354199 5055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:19.354286 5055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:19.354352 5055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260806 10:44:19.384981 5055 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:35101
I20260806 10:44:19.385046 5230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:35101 every 8 connection(s)
I20260806 10:44:19.386226 5055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:44:19.391440 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 5055
I20260806 10:44:19.391621 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:44:19.392248 16565 external_mini_cluster.cc:1428] Setting key e3f876523d79d0ecb8c99b0602abaa18
Aug 06 10:44:19 dist-test-slave-fgb3 krb5kdc[4915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013059, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:19.407162 5237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:19.388727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:35213 (local address 127.16.45.126:40301)
0806 10:44:19.389198 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:19.389203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:19.390191 (+ 988us) server_negotiation.cc:407] Connection header received
0806 10:44:19.392312 (+ 2121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:19.392319 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:19.392412 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:19.392518 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:19.394610 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:19.395354 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:19.396965 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:19.397386 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:19.397517 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:19.401117 (+ 3600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:19.401123 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:19.401126 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:19.401161 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:19.403865 (+ 2704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:19.404620 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:19.404624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:19.404627 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:19.404762 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:19.405208 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:19.405211 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:19.405213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:19.405529 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:19.405677 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:19.406467 (+ 790us) server_negotiation.cc:299] Negotiation successful
0806 10:44:19.406750 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":228,"threads_started":1}
I20260806 10:44:19.408135 5239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:19.389229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:35213)
0806 10:44:19.390005 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:19.390047 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:19.392008 (+ 1961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:19.392847 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:19.392859 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:19.393558 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:19.394410 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:19.394438 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:19.395529 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:19.395535 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:19.396806 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:19.396820 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:19.397628 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:19.397636 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:19.397897 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:19.398635 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:19.398661 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:19.400883 (+ 2222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:19.404018 (+ 3135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:19.404029 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:19.404047 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:19.404486 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:19.404873 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:19.404879 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:19.404883 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:19.405081 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:19.405663 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:19.405671 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:19.406018 (+ 347us) client_negotiation.cc:769] Sending connection context
0806 10:44:19.406291 (+ 273us) client_negotiation.cc:240] Negotiation successful
0806 10:44:19.406869 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":301,"threads_started":1}
I20260806 10:44:19.409797 5234 heartbeater.cc:347] Connected to a master server at 127.16.45.126:40301
I20260806 10:44:19.410127 5234 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:19.411006 5234 heartbeater.cc:511] Master 127.16.45.126:40301 requested a full tablet report, sending...
I20260806 10:44:19.413292 4971 ts_manager.cc:194] Registered new tserver with Master: 1505955c02a7476a8a5ed8f60ebb1d9e (127.16.45.65:35101)
I20260806 10:44:19.415300 4971 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:35213
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:44:19.454139 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:40301
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:19.784663 5250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:19.784961 5250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:19.785090 5250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:19.792384 5250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:19.792517 5250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:19.792678 5250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:44:19.802924 5250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:40301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:19.804255 5250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:19.805567 5250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:19.818353 5256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:19.818413 5259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:19.818578 5261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:19.819522 5250 server_base.cc:1034] running on GCE node
I20260806 10:44:19.820170 5250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:19.821174 5250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:19.822418 5250 hybrid_clock.cc:648] HybridClock initialized: now 1786013059822374 us; error 34 us; skew 500 ppm
I20260806 10:44:19.822726 5250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:19 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013059, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:19.830636 5250 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:44:19.832286 5250 webserver.cc:460] Webserver started at http://127.16.45.66:32781/ using document root <none> and password file <none>
I20260806 10:44:19.832983 5250 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:19.833092 5250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:19.833349 5250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:44:19.836432 5250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "d45063ac5e0540af8e3607d3ea99c96e"
format_stamp: "Formatted at 2026-08-06 10:44:19 on dist-test-slave-fgb3"
server_key: "b1e52fc668b13a6b4214f83579a53b52"
server_key_iv: "db62597d2a337f57a2c343c35195c1ea"
server_key_version: "encryptionkey@0"
I20260806 10:44:19.837193 5250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "d45063ac5e0540af8e3607d3ea99c96e"
format_stamp: "Formatted at 2026-08-06 10:44:19 on dist-test-slave-fgb3"
server_key: "b1e52fc668b13a6b4214f83579a53b52"
server_key_iv: "db62597d2a337f57a2c343c35195c1ea"
server_key_version: "encryptionkey@0"
I20260806 10:44:19.842496 5250 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 10:44:19.846035 5276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:19.847393 5250 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:44:19.847555 5250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "d45063ac5e0540af8e3607d3ea99c96e"
format_stamp: "Formatted at 2026-08-06 10:44:19 on dist-test-slave-fgb3"
server_key: "b1e52fc668b13a6b4214f83579a53b52"
server_key_iv: "db62597d2a337f57a2c343c35195c1ea"
server_key_version: "encryptionkey@0"
I20260806 10:44:19.847745 5250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:19.873726 5250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:19.878001 5250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:19.878286 5250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:19.879299 5250 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:19.880662 5250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:19.880734 5250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:19.880846 5250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:19.880894 5250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:19.912506 5250 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:42457
I20260806 10:44:19.912565 5433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:42457 every 8 connection(s)
I20260806 10:44:19.913772 5250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:44:19.922073 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 5250
I20260806 10:44:19.922380 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:44:19.922983 16565 external_mini_cluster.cc:1428] Setting key 9bcf05ec429b1041683ed21f538f1178
Aug 06 10:44:19 dist-test-slave-fgb3 krb5kdc[4915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013059, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:19.934626 5436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:19.916389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:43637 (local address 127.16.45.126:40301)
0806 10:44:19.916847 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:19.916853 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:19.917779 (+ 926us) server_negotiation.cc:407] Connection header received
0806 10:44:19.919656 (+ 1877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:19.919660 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:19.919731 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:19.919813 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:19.921268 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:19.922031 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:19.924220 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:19.924834 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:19.924956 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:19.928990 (+ 4034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:19.928996 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:19.928999 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:19.929032 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:19.931560 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:19.932430 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:19.932434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:19.932436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:19.932563 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:19.933001 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:19.933003 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:19.933005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:19.933250 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:19.933355 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:19.934158 (+ 803us) server_negotiation.cc:299] Negotiation successful
0806 10:44:19.934353 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":208,"threads_started":1}
I20260806 10:44:19.935992 5437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:19.916882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:43637)
0806 10:44:19.917614 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:19.917652 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:19.919374 (+ 1722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:19.920029 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:19.920036 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:19.920577 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:19.921127 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:19.921144 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:19.922191 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:19.922197 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:19.924069 (+ 1872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:19.924084 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:19.925071 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:19.925077 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:19.925323 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:19.926033 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:19.926065 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:19.928747 (+ 2682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:19.931710 (+ 2963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:19.931719 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:19.931736 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:19.932313 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:19.932663 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:19.932667 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:19.932670 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:19.932911 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:19.933369 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:19.933376 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:19.933798 (+ 422us) client_negotiation.cc:769] Sending connection context
0806 10:44:19.934089 (+ 291us) client_negotiation.cc:240] Negotiation successful
0806 10:44:19.934659 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":268,"threads_started":1}
I20260806 10:44:19.937422 5434 heartbeater.cc:347] Connected to a master server at 127.16.45.126:40301
I20260806 10:44:19.937772 5434 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:19.938604 5434 heartbeater.cc:511] Master 127.16.45.126:40301 requested a full tablet report, sending...
I20260806 10:44:19.940120 4971 ts_manager.cc:194] Registered new tserver with Master: d45063ac5e0540af8e3607d3ea99c96e (127.16.45.66:42457)
I20260806 10:44:19.941174 4971 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:43637
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:44:19.985364 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:40301
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:20.319247 5441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:20.319557 5441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:20.319696 5441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:20.327337 5441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:20.327495 5441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:20.327648 5441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:44:20.337844 5441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:40301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:20.339242 5441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:20.340626 5441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:20.354213 5460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:20.354434 5456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:20.354717 5455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:20.355079 5441 server_base.cc:1034] running on GCE node
I20260806 10:44:20.355758 5441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:20.356773 5441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:20.357995 5441 hybrid_clock.cc:648] HybridClock initialized: now 1786013060357928 us; error 53 us; skew 500 ppm
I20260806 10:44:20.358346 5441 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:20 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013060, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:20.361526 5441 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:44:20.363152 5441 webserver.cc:460] Webserver started at http://127.16.45.67:35823/ using document root <none> and password file <none>
I20260806 10:44:20.363816 5441 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:20.363929 5441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:20.364187 5441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:44:20.367237 5441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "8bf2a423e80641b58a3340bc726bfabb"
format_stamp: "Formatted at 2026-08-06 10:44:20 on dist-test-slave-fgb3"
server_key: "8fee5a217269e1a4119731b1b5d314d1"
server_key_iv: "13e9480093e10791e4ba0e749b5487f5"
server_key_version: "encryptionkey@0"
I20260806 10:44:20.368000 5441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "8bf2a423e80641b58a3340bc726bfabb"
format_stamp: "Formatted at 2026-08-06 10:44:20 on dist-test-slave-fgb3"
server_key: "8fee5a217269e1a4119731b1b5d314d1"
server_key_iv: "13e9480093e10791e4ba0e749b5487f5"
server_key_version: "encryptionkey@0"
I20260806 10:44:20.373278 5441 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:44:20.376857 5469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:20.378234 5441 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:44:20.378449 5441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "8bf2a423e80641b58a3340bc726bfabb"
format_stamp: "Formatted at 2026-08-06 10:44:20 on dist-test-slave-fgb3"
server_key: "8fee5a217269e1a4119731b1b5d314d1"
server_key_iv: "13e9480093e10791e4ba0e749b5487f5"
server_key_version: "encryptionkey@0"
I20260806 10:44:20.378647 5441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:20.418491 5234 heartbeater.cc:503] Master 127.16.45.126:40301 was elected leader, sending a full tablet report...
I20260806 10:44:20.421454 5441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:20.425900 5441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:20.426203 5441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:20.427208 5441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:20.428580 5441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:20.428653 5441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:20.428767 5441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:20.428819 5441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:20.459571 5441 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:33289
I20260806 10:44:20.459617 5637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:33289 every 8 connection(s)
I20260806 10:44:20.460795 5441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:44:20.462893 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 5441
I20260806 10:44:20.463078 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:44:20.463609 16565 external_mini_cluster.cc:1428] Setting key a5c4700b5843cb8e3bbd1b9b9ff93efb
Aug 06 10:44:20 dist-test-slave-fgb3 krb5kdc[4915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013060, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:20.480125 5641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.463670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:54979 (local address 127.16.45.126:40301)
0806 10:44:20.464192 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:20.464197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:20.465192 (+ 995us) server_negotiation.cc:407] Connection header received
0806 10:44:20.467039 (+ 1847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:20.467043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:20.467119 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:20.467205 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:20.468554 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.469347 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.470842 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.471239 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.471364 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.474532 (+ 3168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:20.474536 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:20.474540 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:20.474572 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:20.477053 (+ 2481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:20.477785 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:20.477790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:20.477794 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:20.477953 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:20.478466 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:20.478472 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:20.478475 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:20.478782 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:20.478958 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:20.479659 (+ 701us) server_negotiation.cc:299] Negotiation successful
0806 10:44:20.479839 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":244,"threads_started":1}
I20260806 10:44:20.481017 5644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.464212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:54979)
0806 10:44:20.465034 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:20.465087 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:20.466803 (+ 1716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:20.467368 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:20.467375 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:20.467848 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:20.468404 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:20.468420 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.469458 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.469462 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:20.470714 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:20.470727 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.471433 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.471437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:20.471619 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.472229 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:20.472250 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:20.474347 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:20.477193 (+ 2846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:20.477202 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:20.477216 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:20.477673 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:20.478074 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:20.478077 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:20.478079 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:20.478351 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:20.478924 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:20.478932 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:20.479307 (+ 375us) client_negotiation.cc:769] Sending connection context
0806 10:44:20.479539 (+ 232us) client_negotiation.cc:240] Negotiation successful
0806 10:44:20.479927 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":339,"threads_started":1}
I20260806 10:44:20.482378 5638 heartbeater.cc:347] Connected to a master server at 127.16.45.126:40301
I20260806 10:44:20.482682 5638 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:20.483445 5638 heartbeater.cc:511] Master 127.16.45.126:40301 requested a full tablet report, sending...
I20260806 10:44:20.484840 4971 ts_manager.cc:194] Registered new tserver with Master: 8bf2a423e80641b58a3340bc726bfabb (127.16.45.67:33289)
I20260806 10:44:20.485617 4971 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:54979
I20260806 10:44:20.491210 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:44:20.508816 5641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.495654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50314 (local address 127.16.45.126:40301)
0806 10:44:20.495850 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:20.495856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:20.496172 (+ 316us) server_negotiation.cc:407] Connection header received
0806 10:44:20.496341 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:20.496345 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:20.496408 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:20.496490 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:20.497834 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.498629 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.499980 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.500411 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.500525 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.502974 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:20.502979 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:20.502983 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:20.503020 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:20.505845 (+ 2825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:20.506736 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:20.506741 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:20.506743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:20.506906 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:20.507220 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:20.507223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:20.507225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:20.507640 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:20.507917 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:20.508252 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 10:44:20.508501 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:44:20.513145 4971 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50314:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:44:20.520246 4971 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:44:20.559001 5661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.546466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:33289 (local address 127.0.0.1:34372)
0806 10:44:20.550964 (+ 4498us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:20.550983 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:20.551094 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:20.551737 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:20.551745 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:20.551797 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:20.552307 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:20.552321 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.553860 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.553866 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:20.556427 (+ 2561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:20.556446 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.557855 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.557861 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:20.558066 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.558118 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 10:44:20.558262 (+ 144us) client_negotiation.cc:240] Negotiation successful
0806 10:44:20.558503 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4384,"mutex_wait_us":78,"spinlock_wait_cycles":1408,"thread_start_us":933,"threads_started":1}
I20260806 10:44:20.559163 5667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.532647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:42457 (local address 127.0.0.1:60274)
0806 10:44:20.547737 (+ 15090us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:20.547759 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:20.547892 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:20.551651 (+ 3759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:20.551659 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:20.551691 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:20.552240 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:20.552256 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.554215 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.554221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:20.556478 (+ 2257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:20.556489 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.558300 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.558307 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:20.558522 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.558553 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 10:44:20.558654 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 10:44:20.558788 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14950,"mutex_wait_us":28,"thread_start_us":18301,"threads_started":1}
I20260806 10:44:20.559599 5666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.532945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60274 (local address 127.16.45.66:42457)
0806 10:44:20.550592 (+ 17647us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:20.550602 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:20.550638 (+ 36us) server_negotiation.cc:407] Connection header received
0806 10:44:20.550749 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:20.550757 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:20.551065 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:20.551297 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:20.552479 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.554075 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.556646 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.558067 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.558214 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.558432 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:20.558713 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 10:44:20.558893 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17484,"thread_start_us":17382,"threads_started":1}
I20260806 10:44:20.559712 5660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.532534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35101 (local address 127.0.0.1:49612)
0806 10:44:20.545576 (+ 13042us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:20.545618 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:20.545813 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:20.552359 (+ 6546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:20.552364 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:20.552388 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:20.552756 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:20.552767 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.554552 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.554558 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:20.556650 (+ 2092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:20.556665 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.558718 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.558726 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:20.558900 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.558943 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 10:44:20.559043 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 10:44:20.559184 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12756,"mutex_wait_us":25,"thread_start_us":12570,"threads_started":1}
I20260806 10:44:20.560102 5668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.546508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34372 (local address 127.16.45.67:33289)
0806 10:44:20.551021 (+ 4513us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:20.551029 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:20.551062 (+ 33us) server_negotiation.cc:407] Connection header received
0806 10:44:20.551257 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:20.551267 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:20.551495 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:20.551688 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:20.552541 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.553721 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.556600 (+ 2879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.557648 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.557780 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.558044 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:20.559487 (+ 1443us) server_negotiation.cc:299] Negotiation successful
0806 10:44:20.559632 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4350,"thread_start_us":4168,"threads_started":1}
I20260806 10:44:20.560415 5665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.532876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49612 (local address 127.16.45.65:35101)
0806 10:44:20.551790 (+ 18914us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:20.551798 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:20.551826 (+ 28us) server_negotiation.cc:407] Connection header received
0806 10:44:20.551947 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:20.551955 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:20.552167 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:20.552365 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:20.552957 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.554423 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.556816 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.558233 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.558385 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.558566 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:20.559941 (+ 1375us) server_negotiation.cc:299] Negotiation successful
0806 10:44:20.560101 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18732,"thread_start_us":18466,"threads_started":1}
I20260806 10:44:20.563409 5344 tablet_service.cc:1467] Processing CreateTablet for tablet 532aa088dc2646929605ce18131f2b18 (DEFAULT_TABLE table=test-table [id=ade285ff4aed41faa227b1b67774d484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:44:20.563581 5536 tablet_service.cc:1467] Processing CreateTablet for tablet 532aa088dc2646929605ce18131f2b18 (DEFAULT_TABLE table=test-table [id=ade285ff4aed41faa227b1b67774d484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:44:20.563947 5148 tablet_service.cc:1467] Processing CreateTablet for tablet 532aa088dc2646929605ce18131f2b18 (DEFAULT_TABLE table=test-table [id=ade285ff4aed41faa227b1b67774d484]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:44:20.564659 5344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 532aa088dc2646929605ce18131f2b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:20.565048 5536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 532aa088dc2646929605ce18131f2b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:20.565279 5148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 532aa088dc2646929605ce18131f2b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:20.575351 5669 tablet_bootstrap.cc:492] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e: Bootstrap starting.
I20260806 10:44:20.579353 5671 tablet_bootstrap.cc:492] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e: Bootstrap starting.
I20260806 10:44:20.580389 5669 tablet_bootstrap.cc:654] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:20.581724 5669 log.cc:824] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:20.582986 5670 tablet_bootstrap.cc:492] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb: Bootstrap starting.
I20260806 10:44:20.585279 5669 tablet_bootstrap.cc:492] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e: No bootstrap required, opened a new log
I20260806 10:44:20.585566 5669 ts_tablet_manager.cc:1397] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260806 10:44:20.585624 5671 tablet_bootstrap.cc:654] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:20.586443 5670 tablet_bootstrap.cc:654] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:20.586760 5671 log.cc:824] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:20.587592 5670 log.cc:824] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:20.589562 5671 tablet_bootstrap.cc:492] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e: No bootstrap required, opened a new log
I20260806 10:44:20.589833 5671 ts_tablet_manager.cc:1397] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.002s
I20260806 10:44:20.590592 5670 tablet_bootstrap.cc:492] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb: No bootstrap required, opened a new log
I20260806 10:44:20.590850 5670 ts_tablet_manager.cc:1397] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260806 10:44:20.596221 5669 raft_consensus.cc:348] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } } peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } }
I20260806 10:44:20.596714 5669 raft_consensus.cc:374] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:20.596813 5669 raft_consensus.cc:729] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45063ac5e0540af8e3607d3ea99c96e, State: Initialized, Role: FOLLOWER
I20260806 10:44:20.597482 5669 consensus_queue.cc:260] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } } peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } }
I20260806 10:44:20.597501 5671 raft_consensus.cc:348] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } } peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } }
I20260806 10:44:20.597818 5671 raft_consensus.cc:374] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:20.597904 5671 raft_consensus.cc:729] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1505955c02a7476a8a5ed8f60ebb1d9e, State: Initialized, Role: FOLLOWER
I20260806 10:44:20.598731 5434 heartbeater.cc:503] Master 127.16.45.126:40301 was elected leader, sending a full tablet report...
I20260806 10:44:20.599454 5669 ts_tablet_manager.cc:1428] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e: Time spent starting tablet: real 0.014s user 0.008s sys 0.004s
I20260806 10:44:20.599900 5671 consensus_queue.cc:260] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } } peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } }
I20260806 10:44:20.600792 5670 raft_consensus.cc:348] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } } peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } }
I20260806 10:44:20.601217 5670 raft_consensus.cc:374] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:20.601316 5670 raft_consensus.cc:729] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf2a423e80641b58a3340bc726bfabb, State: Initialized, Role: FOLLOWER
I20260806 10:44:20.601886 5670 consensus_queue.cc:260] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } } peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } }
I20260806 10:44:20.603498 5638 heartbeater.cc:503] Master 127.16.45.126:40301 was elected leader, sending a full tablet report...
I20260806 10:44:20.604054 5670 ts_tablet_manager.cc:1428] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb: Time spent starting tablet: real 0.013s user 0.009s sys 0.003s
I20260806 10:44:20.605072 5671 ts_tablet_manager.cc:1428] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e: Time spent starting tablet: real 0.015s user 0.007s sys 0.005s
W20260806 10:44:20.638634 5235 tablet.cc:2369] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:20.650836 5679 raft_consensus.cc:482] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:44:20.651180 5679 raft_consensus.cc:504] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } } peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } }
I20260806 10:44:20.652976 5679 leader_election.cc:288] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1505955c02a7476a8a5ed8f60ebb1d9e (127.16.45.65:35101), 8bf2a423e80641b58a3340bc726bfabb (127.16.45.67:33289)
I20260806 10:44:20.659802 5665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.653399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:60175 (local address 127.16.45.65:35101)
0806 10:44:20.653594 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:20.653598 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:20.653986 (+ 388us) server_negotiation.cc:407] Connection header received
0806 10:44:20.654203 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:20.654209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:20.654290 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:20.654414 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:20.655078 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.655838 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.658129 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.658934 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.659085 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.659162 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:20.659512 (+ 350us) server_negotiation.cc:299] Negotiation successful
0806 10:44:20.659618 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 10:44:20.660058 5686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.653236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35101 (local address 127.16.45.66:60175)
0806 10:44:20.653882 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:20.653903 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:20.654049 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:20.654537 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:20.654542 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:20.654571 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:20.654920 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:20.654934 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.655952 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.655956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:20.657957 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:20.657981 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.659163 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.659169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:20.659338 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.659372 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 10:44:20.659479 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 10:44:20.659607 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":300,"threads_started":1}
I20260806 10:44:20.661247 5668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.654205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:36603 (local address 127.16.45.67:33289)
0806 10:44:20.654430 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:20.654436 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:20.654741 (+ 305us) server_negotiation.cc:407] Connection header received
0806 10:44:20.654859 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:20.654864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:20.654950 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:20.655035 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:20.656552 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.657599 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.659301 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.660416 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.660571 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.660637 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:20.660892 (+ 255us) server_negotiation.cc:299] Negotiation successful
0806 10:44:20.661018 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 10:44:20.661096 5174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "532aa088dc2646929605ce18131f2b18" candidate_uuid: "d45063ac5e0540af8e3607d3ea99c96e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" is_pre_election: true
I20260806 10:44:20.661309 5687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.653961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:33289 (local address 127.16.45.66:36603)
0806 10:44:20.654627 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:20.654645 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:20.654753 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:20.655980 (+ 1227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:20.655983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:20.656009 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:20.656386 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:20.656395 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.657740 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.657744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:20.659159 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:20.659172 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.660599 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.660603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:20.660724 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.660748 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 10:44:20.660834 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 10:44:20.660953 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":383,"threads_started":1}
I20260806 10:44:20.661616 5174 raft_consensus.cc:2454] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45063ac5e0540af8e3607d3ea99c96e in term 0.
I20260806 10:44:20.662351 5284 leader_election.cc:302] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1505955c02a7476a8a5ed8f60ebb1d9e, d45063ac5e0540af8e3607d3ea99c96e; no voters:
I20260806 10:44:20.662335 5569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "532aa088dc2646929605ce18131f2b18" candidate_uuid: "d45063ac5e0540af8e3607d3ea99c96e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf2a423e80641b58a3340bc726bfabb" is_pre_election: true
I20260806 10:44:20.662775 5679 raft_consensus.cc:2781] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:44:20.662892 5679 raft_consensus.cc:482] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:44:20.662858 5569 raft_consensus.cc:2454] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d45063ac5e0540af8e3607d3ea99c96e in term 0.
I20260806 10:44:20.662993 5679 raft_consensus.cc:3037] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:20.665205 5679 raft_consensus.cc:504] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } } peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } }
I20260806 10:44:20.665863 5679 leader_election.cc:288] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [CANDIDATE]: Term 1 election: Requested vote from peers 1505955c02a7476a8a5ed8f60ebb1d9e (127.16.45.65:35101), 8bf2a423e80641b58a3340bc726bfabb (127.16.45.67:33289)
W20260806 10:44:20.665805 5435 tablet.cc:2369] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:20.666265 5174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "532aa088dc2646929605ce18131f2b18" candidate_uuid: "d45063ac5e0540af8e3607d3ea99c96e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e"
I20260806 10:44:20.666404 5569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "532aa088dc2646929605ce18131f2b18" candidate_uuid: "d45063ac5e0540af8e3607d3ea99c96e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bf2a423e80641b58a3340bc726bfabb"
I20260806 10:44:20.666499 5174 raft_consensus.cc:3037] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:20.666615 5569 raft_consensus.cc:3037] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:20.668671 5174 raft_consensus.cc:2454] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45063ac5e0540af8e3607d3ea99c96e in term 1.
I20260806 10:44:20.668820 5569 raft_consensus.cc:2454] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d45063ac5e0540af8e3607d3ea99c96e in term 1.
I20260806 10:44:20.669028 5284 leader_election.cc:302] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1505955c02a7476a8a5ed8f60ebb1d9e, d45063ac5e0540af8e3607d3ea99c96e; no voters:
I20260806 10:44:20.669323 5679 raft_consensus.cc:2781] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:44:20.669762 5679 raft_consensus.cc:686] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 1 LEADER]: Becoming Leader. State: Replica: d45063ac5e0540af8e3607d3ea99c96e, State: Running, Role: LEADER
I20260806 10:44:20.670202 5679 consensus_queue.cc:237] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } } peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } }
I20260806 10:44:20.674914 4970 catalog_manager.cc:5495] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e reported cstate change: term changed from 0 to 1, leader changed from <none> to d45063ac5e0540af8e3607d3ea99c96e (127.16.45.66). New cstate: current_term: 1 leader_uuid: "d45063ac5e0540af8e3607d3ea99c96e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } health_report { overall_health: UNKNOWN } } }
I20260806 10:44:20.707525 5666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.701848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60282 (local address 127.16.45.66:42457)
0806 10:44:20.702068 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:20.702074 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:20.702094 (+ 20us) server_negotiation.cc:407] Connection header received
0806 10:44:20.702190 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:20.702193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:20.702271 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:20.702441 (+ 170us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:44:20.702831 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.703579 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.704927 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.705311 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.705419 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.705999 (+ 580us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:44:20.706731 (+ 732us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:44:20.706931 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:20.707045 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 10:44:20.707186 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 10:44:20.712508 5640 tablet.cc:2369] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:20.716001 5569 raft_consensus.cc:1261] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb [term 1 FOLLOWER]: Refusing update from remote peer d45063ac5e0540af8e3607d3ea99c96e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:44:20.716004 5174 raft_consensus.cc:1261] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 1 FOLLOWER]: Refusing update from remote peer d45063ac5e0540af8e3607d3ea99c96e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:44:20.716964 5688 consensus_queue.cc:1035] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:44:20.717345 5679 consensus_queue.cc:1035] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:44:20.730656 5697 mvcc.cc:205] Tried to move back new op lower bound from 7315509496682954752 to 7315509496508928000. Current Snapshot: MvccSnapshot[applied={T|T < 7315509496682954752 or (T in {7315509496682954752})}]
I20260806 10:44:20.743045 4971 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:44:20.743316 4971 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:44:20.746793 4971 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Sending DeleteTablet for 3 replicas of tablet 532aa088dc2646929605ce18131f2b18
I20260806 10:44:20.747898 5344 tablet_service.cc:1514] Processing DeleteTablet for tablet 532aa088dc2646929605ce18131f2b18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:44:20 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:60274
I20260806 10:44:20.748085 5536 tablet_service.cc:1514] Processing DeleteTablet for tablet 532aa088dc2646929605ce18131f2b18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:44:20 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:34372
I20260806 10:44:20.749087 5710 tablet_replica.cc:330] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb: stopping tablet replica
I20260806 10:44:20.749605 5710 raft_consensus.cc:2229] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:44:20.749569 5148 tablet_service.cc:1514] Processing DeleteTablet for tablet 532aa088dc2646929605ce18131f2b18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:44:20 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:49612
I20260806 10:44:20.750252 5710 raft_consensus.cc:2258] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:44:20.750564 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 5055
I20260806 10:44:20.752707 5710 ts_tablet_manager.cc:1905] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:20.760318 5709 tablet_replica.cc:330] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e: stopping tablet replica
I20260806 10:44:20.760541 5712 tablet_replica.cc:330] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e: stopping tablet replica
I20260806 10:44:20.760561 5710 ts_tablet_manager.cc:1918] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:44:20.760859 5710 log.cc:1196] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/532aa088dc2646929605ce18131f2b18
I20260806 10:44:20.760880 5709 raft_consensus.cc:2229] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:44:20.761003 5712 raft_consensus.cc:2229] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:44:20.761580 5710 ts_tablet_manager.cc:1939] T 532aa088dc2646929605ce18131f2b18 P 8bf2a423e80641b58a3340bc726bfabb: Deleting consensus metadata
I20260806 10:44:20.761559 5712 raft_consensus.cc:2258] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:44:20.761602 5709 raft_consensus.cc:2258] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:44:20.763999 5712 ts_tablet_manager.cc:1905] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:20.764297 4955 catalog_manager.cc:4841] TS 8bf2a423e80641b58a3340bc726bfabb (127.16.45.67:33289): tablet 532aa088dc2646929605ce18131f2b18 (table test-table [id=ade285ff4aed41faa227b1b67774d484]) successfully deleted
I20260806 10:44:20.766487 5709 ts_tablet_manager.cc:1905] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:20.771962 5712 ts_tablet_manager.cc:1918] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:44:20.772164 5712 log.cc:1196] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/532aa088dc2646929605ce18131f2b18
I20260806 10:44:20.772799 5712 ts_tablet_manager.cc:1939] T 532aa088dc2646929605ce18131f2b18 P 1505955c02a7476a8a5ed8f60ebb1d9e: Deleting consensus metadata
I20260806 10:44:20.774780 5709 ts_tablet_manager.cc:1918] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:44:20.774976 4955 catalog_manager.cc:4841] TS 1505955c02a7476a8a5ed8f60ebb1d9e (127.16.45.65:35101): tablet 532aa088dc2646929605ce18131f2b18 (table test-table [id=ade285ff4aed41faa227b1b67774d484]) successfully deleted
I20260806 10:44:20.775342 5709 log.cc:1196] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/532aa088dc2646929605ce18131f2b18
I20260806 10:44:20.776073 5709 ts_tablet_manager.cc:1939] T 532aa088dc2646929605ce18131f2b18 P d45063ac5e0540af8e3607d3ea99c96e: Deleting consensus metadata
Aug 06 10:44:20 dist-test-slave-fgb3 krb5kdc[4915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:44:20.778087 4953 catalog_manager.cc:4841] TS d45063ac5e0540af8e3607d3ea99c96e (127.16.45.66:42457): tablet 532aa088dc2646929605ce18131f2b18 (table test-table [id=ade285ff4aed41faa227b1b67774d484]) successfully deleted
I20260806 10:44:20.785305 5665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.751970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49628 (local address 127.16.45.65:35101)
0806 10:44:20.752155 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:20.752162 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:20.766338 (+ 14176us) server_negotiation.cc:407] Connection header received
0806 10:44:20.766889 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:20.766895 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:20.766980 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:20.767055 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:20.769139 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.770375 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.772413 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.773115 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.773215 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.779235 (+ 6020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:20.779254 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:20.779270 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:20.779311 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:20.782231 (+ 2920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:20.783117 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:20.783128 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:20.783131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:20.783308 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:20.783701 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:20.783707 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:20.783710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:20.784093 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:20.784386 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:20.784704 (+ 318us) server_negotiation.cc:299] Negotiation successful
0806 10:44:20.784924 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 10:44:20.786158 5226 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:20.875869 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 5055
I20260806 10:44:20.905933 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 5250
Aug 06 10:44:20 dist-test-slave-fgb3 krb5kdc[4915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:44:20.931918 5666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:20.906810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60288 (local address 127.16.45.66:42457)
0806 10:44:20.907030 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:20.907035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:20.907056 (+ 21us) server_negotiation.cc:407] Connection header received
0806 10:44:20.907237 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:20.907241 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:20.907317 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:20.907423 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:20.909045 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.909952 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.911939 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:20.912758 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:20.912912 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:20.923893 (+ 10981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:20.923910 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:20.923930 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:20.923985 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:20.928260 (+ 4275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:20.929221 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:20.929231 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:20.929235 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:20.929432 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:20.929890 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:20.929895 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:20.929899 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:20.930382 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:20.930745 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:20.931070 (+ 325us) server_negotiation.cc:299] Negotiation successful
0806 10:44:20.931315 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260806 10:44:20.932706 5426 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:21.048101 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 5250
I20260806 10:44:21.070922 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 5441
Aug 06 10:44:21 dist-test-slave-fgb3 krb5kdc[4915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:44:21.086428 5668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:21.071690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34388 (local address 127.16.45.67:33289)
0806 10:44:21.071886 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:21.071891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:21.071911 (+ 20us) server_negotiation.cc:407] Connection header received
0806 10:44:21.072066 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:21.072070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:21.072136 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:21.072220 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:21.073437 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:21.074180 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:21.075658 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:21.076084 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:21.076185 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:21.080579 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:21.080597 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:21.080614 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:21.080657 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:21.083718 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:21.084463 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:21.084471 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:21.084474 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:21.084618 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:21.084960 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:21.084964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:21.084966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:21.085375 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:21.085600 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:21.085915 (+ 315us) server_negotiation.cc:299] Negotiation successful
0806 10:44:21.086101 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 10:44:21.087086 5630 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:21.175657 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 5441
I20260806 10:44:21.194883 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 4928
I20260806 10:44:21.196005 5010 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:21.305876 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 4928
I20260806 10:44:21.337499 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40301
--webserver_interface=127.16.45.126
--webserver_port=40827
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:40301
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:21.672765 5724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:21.673079 5724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:21.673177 5724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:21.680594 5724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:44:21.680721 5724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:21.680768 5724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:21.680825 5724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:44:21.680868 5724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:44:21.690970 5724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:40301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=40827
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:21.692298 5724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:21.693671 5724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:21.719044 5733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:21.719074 5742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:21.719044 5734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:21.720197 5724 server_base.cc:1034] running on GCE node
I20260806 10:44:21.721141 5724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:21.722834 5724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:21.724045 5724 hybrid_clock.cc:648] HybridClock initialized: now 1786013061723980 us; error 57 us; skew 500 ppm
I20260806 10:44:21.724443 5724 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:21 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013061, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:21.728132 5724 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:44:21.729862 5724 webserver.cc:460] Webserver started at http://127.16.45.126:40827/ using document root <none> and password file <none>
I20260806 10:44:21.730671 5724 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:21.730799 5724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:21.737036 5724 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 10:44:21.740124 5752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:21.741493 5724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 10:44:21.741665 5724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "d57c9922853b447ba0ae398aff1cbc49"
format_stamp: "Formatted at 2026-08-06 10:44:18 on dist-test-slave-fgb3"
server_key: "a0fefc0237f40f46e284ab82c778a2c2"
server_key_iv: "fb59a00646a0c6befd42cc324840ec9e"
server_key_version: "encryptionkey@0"
I20260806 10:44:21.742846 5724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:21.766809 5724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:21.771453 5724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:21.771731 5724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:21.789997 5724 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:40301
I20260806 10:44:21.790019 5827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:40301 every 8 connection(s)
I20260806 10:44:21.791577 5724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:44:21.796226 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 5724
I20260806 10:44:21.797042 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:35101
--local_ip_for_outbound_sockets=127.16.45.65
--tserver_master_addrs=127.16.45.126:40301
--webserver_port=43395
--webserver_interface=127.16.45.65
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:44:21.799100 5828 sys_catalog.cc:263] Verifying existing consensus state
I20260806 10:44:21.802652 5828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Bootstrap starting.
I20260806 10:44:21.822553 5828 log.cc:824] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:21.835249 5828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 10:44:21.835773 5828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Bootstrap complete.
I20260806 10:44:21.845345 5828 raft_consensus.cc:348] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } }
I20260806 10:44:21.846194 5828 raft_consensus.cc:729] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d57c9922853b447ba0ae398aff1cbc49, State: Initialized, Role: FOLLOWER
I20260806 10:44:21.846860 5828 consensus_queue.cc:260] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } }
I20260806 10:44:21.847095 5828 raft_consensus.cc:388] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:44:21.847227 5828 raft_consensus.cc:482] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:44:21.847398 5828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 1 FOLLOWER]: Advancing to term 2
I20260806 10:44:21.851380 5828 raft_consensus.cc:504] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } }
I20260806 10:44:21.851888 5828 leader_election.cc:302] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d57c9922853b447ba0ae398aff1cbc49; no voters:
I20260806 10:44:21.852499 5828 leader_election.cc:288] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 10:44:21.852635 5833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 10:44:21.853839 5833 raft_consensus.cc:686] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 2 LEADER]: Becoming Leader. State: Replica: d57c9922853b447ba0ae398aff1cbc49, State: Running, Role: LEADER
I20260806 10:44:21.854406 5833 consensus_queue.cc:237] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } }
I20260806 10:44:21.854873 5828 sys_catalog.cc:564] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:44:21.856890 5838 sys_catalog.cc:455] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d57c9922853b447ba0ae398aff1cbc49. Latest consensus state: current_term: 2 leader_uuid: "d57c9922853b447ba0ae398aff1cbc49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } } }
I20260806 10:44:21.857241 5838 sys_catalog.cc:458] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:21.857784 5835 sys_catalog.cc:455] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d57c9922853b447ba0ae398aff1cbc49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } } }
I20260806 10:44:21.858084 5835 sys_catalog.cc:458] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:21.863078 5845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:44:21.871913 5845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:44:21.873333 5845 catalog_manager.cc:1259] Loaded cluster ID: 8aab229fa6cd49fa937c0283ed4263ac
I20260806 10:44:21.873431 5845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:44:21.876587 5845 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 10:44:21.894423 5845 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 10:44:21.903662 5845 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:44:21.905447 5845 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Loaded TSK: 0
I20260806 10:44:21.907015 5845 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 10:44:22.139899 5830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:22.140218 5830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:22.140342 5830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:22.147785 5830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:22.147897 5830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:22.148056 5830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:44:22.158034 5830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:35101
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=43395
--tserver_master_addrs=127.16.45.126:40301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:22.159348 5830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:22.160663 5830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:22.175417 5867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:22.175414 5866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:22.176326 5870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:22.177198 5830 server_base.cc:1034] running on GCE node
I20260806 10:44:22.177822 5830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:22.178854 5830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:22.180078 5830 hybrid_clock.cc:648] HybridClock initialized: now 1786013062180008 us; error 60 us; skew 500 ppm
I20260806 10:44:22.180401 5830 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:22 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013062, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:22.183737 5830 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:44:22.185289 5830 webserver.cc:460] Webserver started at http://127.16.45.65:43395/ using document root <none> and password file <none>
I20260806 10:44:22.185995 5830 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:22.186131 5830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:22.191522 5830 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260806 10:44:22.194378 5882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:22.195741 5830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:44:22.195891 5830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "1505955c02a7476a8a5ed8f60ebb1d9e"
format_stamp: "Formatted at 2026-08-06 10:44:19 on dist-test-slave-fgb3"
server_key: "c9d25c781753fac692e3b12c28818032"
server_key_iv: "55842fda7b659df5572f03910567df92"
server_key_version: "encryptionkey@0"
I20260806 10:44:22.196846 5830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:22.237430 5830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:22.241961 5830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:22.242225 5830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:22.243264 5830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:22.244598 5830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:22.244699 5830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:22.244796 5830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:22.244867 5830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:22.276530 5830 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:35101
I20260806 10:44:22.276619 6038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:35101 every 8 connection(s)
I20260806 10:44:22.278028 5830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:44:22.285173 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 5830
I20260806 10:44:22.285993 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:42457
--local_ip_for_outbound_sockets=127.16.45.66
--tserver_master_addrs=127.16.45.126:40301
--webserver_port=32781
--webserver_interface=127.16.45.66
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 10:44:22 dist-test-slave-fgb3 krb5kdc[4915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013062, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:22.302461 6045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:22.280932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:52083)
0806 10:44:22.281707 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:22.281751 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:22.283443 (+ 1692us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:22.284840 (+ 1397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:22.284851 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:22.285597 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:22.286447 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:22.286472 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:22.288092 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:22.288097 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:22.289803 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:22.289818 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:22.290880 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:22.290886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:22.291142 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:22.291867 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:22.291894 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:22.294445 (+ 2551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:22.297917 (+ 3472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:22.297926 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:22.297942 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:22.298451 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:22.298907 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:22.298912 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:22.298916 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:22.299103 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:22.299841 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:22.299850 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:22.300252 (+ 402us) client_negotiation.cc:769] Sending connection context
0806 10:44:22.300523 (+ 271us) client_negotiation.cc:240] Negotiation successful
0806 10:44:22.301090 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":327,"threads_started":1}
I20260806 10:44:22.302455 6044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:22.280779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:52083 (local address 127.16.45.126:40301)
0806 10:44:22.281403 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:22.281429 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:22.281889 (+ 460us) server_negotiation.cc:407] Connection header received
0806 10:44:22.283966 (+ 2077us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:22.283980 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:22.284300 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:22.284618 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:22.286686 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:22.287920 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:22.289931 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:22.290651 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:22.290785 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:22.294748 (+ 3963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:22.294756 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:22.294771 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:22.294811 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:22.297768 (+ 2957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:22.298591 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:22.298598 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:22.298604 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:22.298790 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:22.299218 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:22.299221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:22.299224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:22.299700 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:22.299921 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:22.300748 (+ 827us) server_negotiation.cc:299] Negotiation successful
0806 10:44:22.301135 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":238,"threads_started":1}
I20260806 10:44:22.305233 6039 heartbeater.cc:347] Connected to a master server at 127.16.45.126:40301
I20260806 10:44:22.305567 6039 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:22.306479 6039 heartbeater.cc:511] Master 127.16.45.126:40301 requested a full tablet report, sending...
I20260806 10:44:22.309103 5777 ts_manager.cc:194] Registered new tserver with Master: 1505955c02a7476a8a5ed8f60ebb1d9e (127.16.45.65:35101)
I20260806 10:44:22.311337 5777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:52083
W20260806 10:44:22.616525 6046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:22.616801 6046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:22.616894 6046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:22.624074 6046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:22.624183 6046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:22.624302 6046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:44:22.634161 6046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:42457
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=32781
--tserver_master_addrs=127.16.45.126:40301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:22.635455 6046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:22.636735 6046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:22.649889 6051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:22.649966 6052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:22.649907 6054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:22.651006 6046 server_base.cc:1034] running on GCE node
I20260806 10:44:22.651643 6046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:22.652576 6046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:22.653775 6046 hybrid_clock.cc:648] HybridClock initialized: now 1786013062653723 us; error 42 us; skew 500 ppm
I20260806 10:44:22.654088 6046 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:22 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013062, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:22.657182 6046 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:44:22.658735 6046 webserver.cc:460] Webserver started at http://127.16.45.66:32781/ using document root <none> and password file <none>
I20260806 10:44:22.659420 6046 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:22.659557 6046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:22.665150 6046 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 10:44:22.667877 6063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:22.669355 6046 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 10:44:22.669515 6046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "d45063ac5e0540af8e3607d3ea99c96e"
format_stamp: "Formatted at 2026-08-06 10:44:19 on dist-test-slave-fgb3"
server_key: "b1e52fc668b13a6b4214f83579a53b52"
server_key_iv: "db62597d2a337f57a2c343c35195c1ea"
server_key_version: "encryptionkey@0"
I20260806 10:44:22.670586 6046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:22.710446 6046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:22.715332 6046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:22.715652 6046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:22.716939 6046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:22.718341 6046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:22.718462 6046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:22.718547 6046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:22.718602 6046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:22.749377 6046 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:42457
I20260806 10:44:22.749441 6208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:42457 every 8 connection(s)
I20260806 10:44:22.750867 6046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:44:22.755779 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 6046
I20260806 10:44:22.756544 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:33289
--local_ip_for_outbound_sockets=127.16.45.67
--tserver_master_addrs=127.16.45.126:40301
--webserver_port=35823
--webserver_interface=127.16.45.67
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 10:44:22 dist-test-slave-fgb3 krb5kdc[4915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013062, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:22.772858 6044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:22.753357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:53875 (local address 127.16.45.126:40301)
0806 10:44:22.753536 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:22.753540 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:22.754774 (+ 1234us) server_negotiation.cc:407] Connection header received
0806 10:44:22.757178 (+ 2404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:22.757183 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:22.757278 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:22.757368 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:22.759434 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:22.760309 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:22.762415 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:22.762889 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:22.763013 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:22.767030 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:22.767035 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:22.767039 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:22.767075 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:22.769752 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:22.770499 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:22.770503 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:22.770506 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:22.770639 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:22.771071 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:22.771075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:22.771077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:22.771356 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:22.771521 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:22.772236 (+ 715us) server_negotiation.cc:299] Negotiation successful
0806 10:44:22.772492 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 10:44:22.774035 6211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:22.753822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:53875)
0806 10:44:22.754613 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:22.754677 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:22.756869 (+ 2192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:22.757633 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:22.757645 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:22.758398 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:22.759170 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:22.759193 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:22.760481 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:22.760486 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:22.762241 (+ 1755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:22.762258 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:22.763130 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:22.763137 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:22.763395 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:22.764086 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:22.764113 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:22.766786 (+ 2673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:22.769886 (+ 3100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:22.769892 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:22.769907 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:22.770369 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:22.770745 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:22.770750 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:22.770754 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:22.770955 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:22.771489 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:22.771498 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:22.771852 (+ 354us) client_negotiation.cc:769] Sending connection context
0806 10:44:22.772104 (+ 252us) client_negotiation.cc:240] Negotiation successful
0806 10:44:22.772697 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":265,"threads_started":1}
I20260806 10:44:22.775625 6209 heartbeater.cc:347] Connected to a master server at 127.16.45.126:40301
I20260806 10:44:22.775959 6209 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:22.776721 6209 heartbeater.cc:511] Master 127.16.45.126:40301 requested a full tablet report, sending...
I20260806 10:44:22.778216 5777 ts_manager.cc:194] Registered new tserver with Master: d45063ac5e0540af8e3607d3ea99c96e (127.16.45.66:42457)
I20260806 10:44:22.779078 5777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:53875
W20260806 10:44:23.089742 6213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:23.090046 6213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:23.090169 6213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:23.097460 6213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:23.097586 6213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:23.097746 6213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:44:23.107520 6213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:33289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=35823
--tserver_master_addrs=127.16.45.126:40301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:23.108836 6213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:23.110147 6213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:23.122962 6218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:23.123044 6220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:23.122996 6222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:23.124132 6213 server_base.cc:1034] running on GCE node
I20260806 10:44:23.124747 6213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:23.125672 6213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:23.126873 6213 hybrid_clock.cc:648] HybridClock initialized: now 1786013063126823 us; error 54 us; skew 500 ppm
I20260806 10:44:23.127179 6213 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:23 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013063, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:23.130229 6213 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:44:23.131711 6213 webserver.cc:460] Webserver started at http://127.16.45.67:35823/ using document root <none> and password file <none>
I20260806 10:44:23.132383 6213 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:23.132524 6213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:23.138077 6213 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.000s
I20260806 10:44:23.140904 6231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:23.142446 6213 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 10:44:23.142609 6213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "8bf2a423e80641b58a3340bc726bfabb"
format_stamp: "Formatted at 2026-08-06 10:44:20 on dist-test-slave-fgb3"
server_key: "8fee5a217269e1a4119731b1b5d314d1"
server_key_iv: "13e9480093e10791e4ba0e749b5487f5"
server_key_version: "encryptionkey@0"
I20260806 10:44:23.143579 6213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:23.163188 6213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:23.167346 6213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:23.167582 6213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:23.168527 6213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:23.169824 6213 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:23.169926 6213 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:23.170011 6213 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:23.170068 6213 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:23.200994 6213 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:33289
I20260806 10:44:23.201107 6378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:33289 every 8 connection(s)
I20260806 10:44:23.202663 6213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:44:23.207587 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 6213
Aug 06 10:44:23 dist-test-slave-fgb3 krb5kdc[4915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013063, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:23.222831 6383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.208637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50318 (local address 127.16.45.126:40301)
0806 10:44:23.209476 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:23.209482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:23.209501 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:44:23.209555 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:23.209560 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:23.209626 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:23.209740 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:23.211296 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.212082 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.213466 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.214025 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.214137 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.216894 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:23.216899 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:23.216902 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:23.216935 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:23.220012 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:23.220733 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:23.220744 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:23.220746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:23.220889 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:23.221268 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:23.221273 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:23.221275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:23.221591 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:23.221835 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:23.222135 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 10:44:23.222400 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":725,"thread_start_us":590,"threads_started":1}
I20260806 10:44:23.223099 6044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.205176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:33227 (local address 127.16.45.126:40301)
0806 10:44:23.205394 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:23.205400 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:23.206507 (+ 1107us) server_negotiation.cc:407] Connection header received
0806 10:44:23.208442 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:23.208448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:23.208548 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:23.208666 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:23.210613 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.211357 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.212936 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.213363 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.213471 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.217095 (+ 3624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:23.217103 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:23.217106 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:23.217149 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:23.220039 (+ 2890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:23.220759 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:23.220764 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:23.220766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:23.220900 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:23.221319 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:23.221322 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:23.221324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:23.221613 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:23.221737 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:23.222487 (+ 750us) server_negotiation.cc:299] Negotiation successful
0806 10:44:23.222695 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":71}
I20260806 10:44:23.224206 6381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.205642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:33227)
0806 10:44:23.206359 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.206403 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:23.208083 (+ 1680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:23.208978 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:23.208989 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:23.209755 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:23.210442 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:23.210463 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.211533 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.211537 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:23.212779 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:23.212792 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.213608 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.213617 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:23.213896 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.214588 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:23.214616 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:23.216877 (+ 2261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:23.220175 (+ 3298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:23.220185 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:23.220203 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:23.220633 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:23.221006 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:23.221011 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:23.221014 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:23.221199 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:23.221736 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:23.221745 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:23.222094 (+ 349us) client_negotiation.cc:769] Sending connection context
0806 10:44:23.222398 (+ 304us) client_negotiation.cc:240] Negotiation successful
0806 10:44:23.222957 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":268,"threads_started":1}
I20260806 10:44:23.225622 6379 heartbeater.cc:347] Connected to a master server at 127.16.45.126:40301
I20260806 10:44:23.225889 6379 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:23.226624 6379 heartbeater.cc:511] Master 127.16.45.126:40301 requested a full tablet report, sending...
I20260806 10:44:23.227973 5777 ts_manager.cc:194] Registered new tserver with Master: 8bf2a423e80641b58a3340bc726bfabb (127.16.45.67:33289)
I20260806 10:44:23.228771 5777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:33227
I20260806 10:44:23.237926 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:44:23.245007 6383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.239042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50324 (local address 127.16.45.126:40301)
0806 10:44:23.239280 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:23.239287 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:23.239604 (+ 317us) server_negotiation.cc:407] Connection header received
0806 10:44:23.239794 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:23.239798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:23.239945 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:23.240073 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:44:23.240538 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.241270 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.242825 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.243255 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.243347 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.243824 (+ 477us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:44:23.244373 (+ 549us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:44:23.244492 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:23.244645 (+ 153us) server_negotiation.cc:299] Negotiation successful
0806 10:44:23.244718 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 10:44:23.246043 5777 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:50324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:44:23.253542 5777 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:44:23.277861 6399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.268502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35101 (local address 127.0.0.1:49634)
0806 10:44:23.269463 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.269482 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:23.269604 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:23.270633 (+ 1029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:23.270639 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:23.270664 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:23.271121 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:23.271134 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.273008 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.273028 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:23.275257 (+ 2229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:23.275285 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.276896 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.276904 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:23.277079 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.277132 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 10:44:23.277256 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 10:44:23.277458 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":829,"mutex_wait_us":23,"thread_start_us":683,"threads_started":1}
I20260806 10:44:23.278228 6393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.265783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:33289 (local address 127.0.0.1:34398)
0806 10:44:23.267603 (+ 1820us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.267638 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:23.267805 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:23.269620 (+ 1815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:23.269629 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:23.269658 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:23.270049 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:23.270063 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.271994 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.271998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:23.273998 (+ 2000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:23.274013 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.275616 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.275622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:23.277505 (+ 1883us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.277540 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 10:44:23.277633 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 10:44:23.277768 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1573,"mutex_wait_us":5,"thread_start_us":2278,"threads_started":1}
I20260806 10:44:23.278990 6396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.266052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34398 (local address 127.16.45.67:33289)
0806 10:44:23.269007 (+ 2955us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:23.269015 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:23.269047 (+ 32us) server_negotiation.cc:407] Connection header received
0806 10:44:23.269133 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:23.269140 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:23.269355 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:23.270245 (+ 890us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:23.270530 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.271851 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.274203 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.275406 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.275549 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.275787 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:23.278479 (+ 2692us) server_negotiation.cc:299] Negotiation successful
0806 10:44:23.278655 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2773,"thread_start_us":2623,"threads_started":1}
I20260806 10:44:23.279043 6400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.269006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49634 (local address 127.16.45.65:35101)
0806 10:44:23.270048 (+ 1042us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:23.270056 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:23.270083 (+ 27us) server_negotiation.cc:407] Connection header received
0806 10:44:23.270170 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:23.270176 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:23.270417 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:23.270625 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:23.271388 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.272867 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.275438 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.276634 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.278161 (+ 1527us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.278422 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:23.278503 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 10:44:23.278684 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":905,"thread_start_us":819,"threads_started":1}
I20260806 10:44:23.279098 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.266156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:42457 (local address 127.0.0.1:60300)
0806 10:44:23.268308 (+ 2152us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.268325 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:23.268445 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:23.270408 (+ 1963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:23.270413 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:23.270437 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:23.270894 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:23.270906 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.272918 (+ 2012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.272924 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:23.275317 (+ 2393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:23.275328 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.278344 (+ 3016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.278352 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:23.278540 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.278571 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 10:44:23.278645 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 10:44:23.278762 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2033,"mutex_wait_us":6,"thread_start_us":1062,"threads_started":1}
I20260806 10:44:23.279918 6398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.266574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60300 (local address 127.16.45.66:42457)
0806 10:44:23.268451 (+ 1877us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:23.268459 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:23.268495 (+ 36us) server_negotiation.cc:407] Connection header received
0806 10:44:23.268605 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:23.268613 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:23.268861 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:23.270157 (+ 1296us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:23.271067 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.272715 (+ 1648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.275481 (+ 2766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.276945 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.277088 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.277285 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:23.279468 (+ 2183us) server_negotiation.cc:299] Negotiation successful
0806 10:44:23.279642 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1712,"thread_start_us":2308,"threads_started":1}
I20260806 10:44:23.283190 6295 tablet_service.cc:1467] Processing CreateTablet for tablet f007320237684befa55d0689bb61c473 (DEFAULT_TABLE table=test-table [id=14bb435c41e54da79901cf2c8efa8494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:44:23.283295 6123 tablet_service.cc:1467] Processing CreateTablet for tablet f007320237684befa55d0689bb61c473 (DEFAULT_TABLE table=test-table [id=14bb435c41e54da79901cf2c8efa8494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:44:23.283988 5952 tablet_service.cc:1467] Processing CreateTablet for tablet f007320237684befa55d0689bb61c473 (DEFAULT_TABLE table=test-table [id=14bb435c41e54da79901cf2c8efa8494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:44:23.284648 6295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f007320237684befa55d0689bb61c473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:23.284647 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f007320237684befa55d0689bb61c473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:23.285082 5952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f007320237684befa55d0689bb61c473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:23.296295 6402 tablet_bootstrap.cc:492] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: Bootstrap starting.
I20260806 10:44:23.299621 6404 tablet_bootstrap.cc:492] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e: Bootstrap starting.
I20260806 10:44:23.301165 6402 tablet_bootstrap.cc:654] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:23.301203 6405 tablet_bootstrap.cc:492] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb: Bootstrap starting.
I20260806 10:44:23.302479 6402 log.cc:824] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:23.303328 6404 tablet_bootstrap.cc:654] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:23.304384 6405 tablet_bootstrap.cc:654] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:23.304450 6404 log.cc:824] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:23.305573 6405 log.cc:824] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:23.305963 6402 tablet_bootstrap.cc:492] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: No bootstrap required, opened a new log
I20260806 10:44:23.306270 6402 ts_tablet_manager.cc:1397] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260806 10:44:23.308079 6405 tablet_bootstrap.cc:492] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb: No bootstrap required, opened a new log
I20260806 10:44:23.308310 6405 ts_tablet_manager.cc:1397] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 10:44:23.313546 6404 tablet_bootstrap.cc:492] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e: No bootstrap required, opened a new log
I20260806 10:44:23.313812 6404 ts_tablet_manager.cc:1397] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20260806 10:44:23.315349 6039 heartbeater.cc:503] Master 127.16.45.126:40301 was elected leader, sending a full tablet report...
I20260806 10:44:23.318893 6402 raft_consensus.cc:348] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } } peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } }
I20260806 10:44:23.319336 6402 raft_consensus.cc:374] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:23.319433 6402 raft_consensus.cc:729] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1505955c02a7476a8a5ed8f60ebb1d9e, State: Initialized, Role: FOLLOWER
I20260806 10:44:23.320052 6402 consensus_queue.cc:260] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } } peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } }
I20260806 10:44:23.322558 6405 raft_consensus.cc:348] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } } peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } }
I20260806 10:44:23.322898 6405 raft_consensus.cc:374] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:23.322996 6405 raft_consensus.cc:729] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bf2a423e80641b58a3340bc726bfabb, State: Initialized, Role: FOLLOWER
I20260806 10:44:23.323534 6405 consensus_queue.cc:260] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } } peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } }
I20260806 10:44:23.324131 6404 raft_consensus.cc:348] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } } peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } }
I20260806 10:44:23.324554 6379 heartbeater.cc:503] Master 127.16.45.126:40301 was elected leader, sending a full tablet report...
I20260806 10:44:23.324576 6404 raft_consensus.cc:374] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:23.324663 6404 raft_consensus.cc:729] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45063ac5e0540af8e3607d3ea99c96e, State: Initialized, Role: FOLLOWER
I20260806 10:44:23.325213 6405 ts_tablet_manager.cc:1428] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb: Time spent starting tablet: real 0.017s user 0.012s sys 0.000s
I20260806 10:44:23.325814 6404 consensus_queue.cc:260] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } } peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } }
I20260806 10:44:23.326189 6402 ts_tablet_manager.cc:1428] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: Time spent starting tablet: real 0.020s user 0.013s sys 0.004s
I20260806 10:44:23.326970 6209 heartbeater.cc:503] Master 127.16.45.126:40301 was elected leader, sending a full tablet report...
I20260806 10:44:23.327834 6404 ts_tablet_manager.cc:1428] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e: Time spent starting tablet: real 0.014s user 0.005s sys 0.009s
W20260806 10:44:23.454370 6380 tablet.cc:2369] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:23.469234 6410 raft_consensus.cc:482] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:44:23.469563 6410 raft_consensus.cc:504] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } } peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } }
I20260806 10:44:23.471618 6410 leader_election.cc:288] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1505955c02a7476a8a5ed8f60ebb1d9e (127.16.45.65:35101), d45063ac5e0540af8e3607d3ea99c96e (127.16.45.66:42457)
I20260806 10:44:23.478619 6398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.472493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:34041 (local address 127.16.45.66:42457)
0806 10:44:23.472705 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:23.472709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:23.472725 (+ 16us) server_negotiation.cc:407] Connection header received
0806 10:44:23.472784 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:23.472787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:23.472860 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:23.472959 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:23.473322 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.474289 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.476695 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.477841 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.478014 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.478090 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:23.478271 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 10:44:23.478425 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 10:44:23.478698 6381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.471943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:42457 (local address 127.16.45.67:34041)
0806 10:44:23.472221 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.472242 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:23.472370 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:23.472993 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:23.472996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:23.473020 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:23.473184 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:23.473194 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.474438 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.474442 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:23.476551 (+ 2109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:23.476567 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.477993 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.477997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:23.478126 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.478150 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 10:44:23.478230 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 10:44:23.478399 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":28}
I20260806 10:44:23.479063 6400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.472071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:47759 (local address 127.16.45.65:35101)
0806 10:44:23.472266 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:23.472272 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:23.472861 (+ 589us) server_negotiation.cc:407] Connection header received
0806 10:44:23.472996 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:23.473002 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:23.473077 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:23.473151 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:23.473665 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.474616 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.476928 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.478156 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.478306 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.478397 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:23.478715 (+ 318us) server_negotiation.cc:299] Negotiation successful
0806 10:44:23.478836 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 10:44:23.479199 6413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.472006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35101 (local address 127.16.45.67:47759)
0806 10:44:23.472743 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.472757 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:23.472878 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:23.473189 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:23.473192 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:23.473214 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:23.473505 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:23.473514 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.474756 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.474761 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:23.476785 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:23.476796 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.478377 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.478382 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:23.478541 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.478579 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 10:44:23.478668 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 10:44:23.478815 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":20,"thread_start_us":433,"threads_started":1}
I20260806 10:44:23.479887 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f007320237684befa55d0689bb61c473" candidate_uuid: "8bf2a423e80641b58a3340bc726bfabb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45063ac5e0540af8e3607d3ea99c96e" is_pre_election: true
I20260806 10:44:23.480114 5975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f007320237684befa55d0689bb61c473" candidate_uuid: "8bf2a423e80641b58a3340bc726bfabb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" is_pre_election: true
I20260806 10:44:23.480345 6151 raft_consensus.cc:2454] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf2a423e80641b58a3340bc726bfabb in term 0.
I20260806 10:44:23.480587 5975 raft_consensus.cc:2454] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bf2a423e80641b58a3340bc726bfabb in term 0.
I20260806 10:44:23.481014 6234 leader_election.cc:302] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bf2a423e80641b58a3340bc726bfabb, d45063ac5e0540af8e3607d3ea99c96e; no voters:
I20260806 10:44:23.481446 6410 raft_consensus.cc:2781] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:44:23.481572 6410 raft_consensus.cc:482] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:44:23.481644 6410 raft_consensus.cc:3037] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:23.483827 6410 raft_consensus.cc:504] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } } peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } }
I20260806 10:44:23.484494 6410 leader_election.cc:288] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [CANDIDATE]: Term 1 election: Requested vote from peers 1505955c02a7476a8a5ed8f60ebb1d9e (127.16.45.65:35101), d45063ac5e0540af8e3607d3ea99c96e (127.16.45.66:42457)
I20260806 10:44:23.484903 5975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f007320237684befa55d0689bb61c473" candidate_uuid: "8bf2a423e80641b58a3340bc726bfabb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e"
I20260806 10:44:23.485105 5975 raft_consensus.cc:3037] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:23.485136 6151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f007320237684befa55d0689bb61c473" candidate_uuid: "8bf2a423e80641b58a3340bc726bfabb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d45063ac5e0540af8e3607d3ea99c96e"
I20260806 10:44:23.485327 6151 raft_consensus.cc:3037] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:23.487341 5975 raft_consensus.cc:2454] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf2a423e80641b58a3340bc726bfabb in term 1.
I20260806 10:44:23.487573 6151 raft_consensus.cc:2454] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bf2a423e80641b58a3340bc726bfabb in term 1.
I20260806 10:44:23.487723 6237 leader_election.cc:302] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1505955c02a7476a8a5ed8f60ebb1d9e, 8bf2a423e80641b58a3340bc726bfabb; no voters:
I20260806 10:44:23.488054 6410 raft_consensus.cc:2781] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:44:23.488466 6410 raft_consensus.cc:686] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 1 LEADER]: Becoming Leader. State: Replica: 8bf2a423e80641b58a3340bc726bfabb, State: Running, Role: LEADER
I20260806 10:44:23.488926 6410 consensus_queue.cc:237] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } } peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } }
I20260806 10:44:23.493454 5776 catalog_manager.cc:5495] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bf2a423e80641b58a3340bc726bfabb (127.16.45.67). New cstate: current_term: 1 leader_uuid: "8bf2a423e80641b58a3340bc726bfabb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bf2a423e80641b58a3340bc726bfabb" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 33289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 } health_report { overall_health: UNKNOWN } } }
W20260806 10:44:23.502888 6210 tablet.cc:2369] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:23.529387 6396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.524073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34414 (local address 127.16.45.67:33289)
0806 10:44:23.524240 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:23.524244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:23.524325 (+ 81us) server_negotiation.cc:407] Connection header received
0806 10:44:23.524563 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:23.524568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:23.524652 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:23.524800 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:44:23.525111 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.525858 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.527421 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.527818 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.527912 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.528403 (+ 491us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:44:23.528883 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:44:23.529005 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:23.529091 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 10:44:23.529156 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260806 10:44:23.531265 6042 tablet.cc:2369] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:23.537247 5975 raft_consensus.cc:1261] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 1 FOLLOWER]: Refusing update from remote peer 8bf2a423e80641b58a3340bc726bfabb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:44:23.537247 6151 raft_consensus.cc:1261] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e [term 1 FOLLOWER]: Refusing update from remote peer 8bf2a423e80641b58a3340bc726bfabb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:44:23.538173 6415 consensus_queue.cc:1035] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1505955c02a7476a8a5ed8f60ebb1d9e" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:44:23.538579 6410 consensus_queue.cc:1035] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d45063ac5e0540af8e3607d3ea99c96e" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:44:23.549263 6419 mvcc.cc:205] Tried to move back new op lower bound from 7315509508239409152 to 7315509508054421504. Current Snapshot: MvccSnapshot[applied={T|T < 7315509508239409152}]
I20260806 10:44:23.566141 5776 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:50324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:44:23.566497 5776 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:50324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:44:23.570191 5776 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Sending DeleteTablet for 3 replicas of tablet f007320237684befa55d0689bb61c473
I20260806 10:44:23.571549 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet f007320237684befa55d0689bb61c473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:44:23 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:60300
I20260806 10:44:23.571560 6295 tablet_service.cc:1514] Processing DeleteTablet for tablet f007320237684befa55d0689bb61c473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:44:23 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:34398
I20260806 10:44:23.571703 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 5830
I20260806 10:44:23.572711 6432 tablet_replica.cc:330] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e: stopping tablet replica
I20260806 10:44:23.572731 5952 tablet_service.cc:1514] Processing DeleteTablet for tablet f007320237684befa55d0689bb61c473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:44:23 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:49634
I20260806 10:44:23.573170 6432 raft_consensus.cc:2229] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:44:23.573455 6433 tablet_replica.cc:330] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb: stopping tablet replica
I20260806 10:44:23.573702 6432 raft_consensus.cc:2258] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:44:23.575699 6433 raft_consensus.cc:2229] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:44:23.575814 6432 ts_tablet_manager.cc:1905] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:23.576342 6433 raft_consensus.cc:2258] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:44:23.578992 6434 tablet_replica.cc:330] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: stopping tablet replica
I20260806 10:44:23.580744 6433 ts_tablet_manager.cc:1905] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:23.581820 6432 ts_tablet_manager.cc:1918] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:44:23.581979 6432 log.cc:1196] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/f007320237684befa55d0689bb61c473
I20260806 10:44:23.582595 6432 ts_tablet_manager.cc:1939] T f007320237684befa55d0689bb61c473 P d45063ac5e0540af8e3607d3ea99c96e: Deleting consensus metadata
I20260806 10:44:23.582917 6434 raft_consensus.cc:2229] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:44:23.583786 6434 raft_consensus.cc:2258] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:44:23.584564 5754 catalog_manager.cc:4841] TS d45063ac5e0540af8e3607d3ea99c96e (127.16.45.66:42457): tablet f007320237684befa55d0689bb61c473 (table test-table [id=14bb435c41e54da79901cf2c8efa8494]) successfully deleted
I20260806 10:44:23.586463 6434 ts_tablet_manager.cc:1905] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:23.590102 6400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.573252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49636 (local address 127.16.45.65:35101)
0806 10:44:23.573438 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:23.573443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:23.573461 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:44:23.573517 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:23.573521 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:23.573594 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:23.573706 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:23.575467 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.576528 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.578397 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.579035 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.579175 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.582575 (+ 3400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:23.582595 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:23.582613 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:23.582657 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:23.586717 (+ 4060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:23.587717 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:23.587731 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:23.587734 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:23.587924 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:23.588360 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:23.588364 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:23.588367 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:23.588871 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:23.589157 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:23.589490 (+ 333us) server_negotiation.cc:299] Negotiation successful
0806 10:44:23.589734 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 10:44:23.591172 6033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:23.596446 6433 ts_tablet_manager.cc:1918] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:44:23.596649 6433 log.cc:1196] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/f007320237684befa55d0689bb61c473
I20260806 10:44:23.597273 6433 ts_tablet_manager.cc:1939] T f007320237684befa55d0689bb61c473 P 8bf2a423e80641b58a3340bc726bfabb: Deleting consensus metadata
I20260806 10:44:23.599373 5758 catalog_manager.cc:4841] TS 8bf2a423e80641b58a3340bc726bfabb (127.16.45.67:33289): tablet f007320237684befa55d0689bb61c473 (table test-table [id=14bb435c41e54da79901cf2c8efa8494]) successfully deleted
I20260806 10:44:23.682032 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 5830
W20260806 10:44:23.706655 5758 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.45.65:35101 (error 108)
I20260806 10:44:23.707566 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 6046
I20260806 10:44:23.708765 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.708191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35101 (local address 127.0.0.1:49336)
0806 10:44:23.708478 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.708593 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167}
W20260806 10:44:23.709074 5758 catalog_manager.cc:4584] TS 1505955c02a7476a8a5ed8f60ebb1d9e (127.16.45.65:35101): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f007320237684befa55d0689bb61c473: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35101: connect: Connection refused (error 111)
I20260806 10:44:23.722249 6398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.708420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47054 (local address 127.16.45.66:42457)
0806 10:44:23.708599 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:23.708604 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:23.708625 (+ 21us) server_negotiation.cc:407] Connection header received
0806 10:44:23.708793 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:23.708797 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:23.708877 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:23.708991 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:23.710460 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.711207 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.712545 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.712955 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.713063 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.715683 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:23.715696 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:23.715711 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:23.715747 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:23.719224 (+ 3477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:23.720167 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:23.720178 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:23.720182 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:23.720340 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:23.720702 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:23.720707 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:23.720710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:23.721186 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:23.721489 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:23.721637 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 10:44:23.721879 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 10:44:23.723014 6204 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:23.763037 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.762481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35101 (local address 127.0.0.1:49346)
0806 10:44:23.762709 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.762832 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 10:44:23.764374 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.763942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35101 (local address 127.0.0.1:49356)
0806 10:44:23.764099 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.764188 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 10:44:23.812809 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 6046
I20260806 10:44:23.824973 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.824551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35101 (local address 127.0.0.1:49364)
0806 10:44:23.824719 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.824814 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 10:44:23.826144 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.825780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35101 (local address 127.0.0.1:49380)
0806 10:44:23.825951 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.826025 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 10:44:23.847101 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 6213
I20260806 10:44:23.864005 6396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.847920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54556 (local address 127.16.45.67:33289)
0806 10:44:23.848143 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:23.848150 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:23.848175 (+ 25us) server_negotiation.cc:407] Connection header received
0806 10:44:23.848436 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:23.848443 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:23.848529 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:23.848646 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:23.850127 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.851388 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.852777 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:23.853437 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:23.853568 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:23.856567 (+ 2999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:23.856583 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:23.856605 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:23.856679 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:23.860790 (+ 4111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:23.861562 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:23.861572 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:23.861576 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:23.861796 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:23.862186 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:23.862192 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:23.862196 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:23.862676 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:23.863012 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:23.863286 (+ 274us) server_negotiation.cc:299] Negotiation successful
0806 10:44:23.863537 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260806 10:44:23.864897 6370 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:23.907402 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.906867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35101 (local address 127.0.0.1:49392)
0806 10:44:23.907118 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.907214 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260806 10:44:23.908458 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:23.908046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35101 (local address 127.0.0.1:49408)
0806 10:44:23.908274 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:23.908346 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260806 10:44:23.985692 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 6213
I20260806 10:44:24.011723 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 5724
I20260806 10:44:24.012959 5822 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:24.127550 6392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:24.126921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:35101 (local address 127.0.0.1:49412)
0806 10:44:24.127203 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:24.127343 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260806 10:44:24.127554 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 5724
I20260806 10:44:24.153929 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40301
--webserver_interface=127.16.45.126
--webserver_port=40827
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:40301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:24.489393 6441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:24.489673 6441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:24.489805 6441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:24.497095 6441 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:44:24.497202 6441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:24.497282 6441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:24.497357 6441 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:44:24.497416 6441 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:44:24.507213 6441 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:40301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=40827
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:24.508592 6441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:24.509996 6441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:24.521376 6448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:24.521339 6452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:24.521313 6450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:24.522078 6441 server_base.cc:1034] running on GCE node
I20260806 10:44:24.522873 6441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:24.524204 6441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:24.525410 6441 hybrid_clock.cc:648] HybridClock initialized: now 1786013064525356 us; error 43 us; skew 500 ppm
I20260806 10:44:24.525724 6441 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:24 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013064, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:24.528716 6441 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:44:24.530107 6441 webserver.cc:460] Webserver started at http://127.16.45.126:40827/ using document root <none> and password file <none>
I20260806 10:44:24.530757 6441 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:24.530860 6441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:24.536128 6441 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 10:44:24.538882 6468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:24.540176 6441 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 10:44:24.540336 6441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "d57c9922853b447ba0ae398aff1cbc49"
format_stamp: "Formatted at 2026-08-06 10:44:18 on dist-test-slave-fgb3"
server_key: "a0fefc0237f40f46e284ab82c778a2c2"
server_key_iv: "fb59a00646a0c6befd42cc324840ec9e"
server_key_version: "encryptionkey@0"
I20260806 10:44:24.541316 6441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:24.556892 6441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:24.561462 6441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:24.561780 6441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:24.580804 6441 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:40301
I20260806 10:44:24.580840 6543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:40301 every 8 connection(s)
I20260806 10:44:24.582494 6441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:44:24.589520 6544 sys_catalog.cc:263] Verifying existing consensus state
I20260806 10:44:24.590639 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 6441
I20260806 10:44:24.591666 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:35101
--local_ip_for_outbound_sockets=127.16.45.65
--tserver_master_addrs=127.16.45.126:40301
--webserver_port=43395
--webserver_interface=127.16.45.65
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:44:24.594203 6544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Bootstrap starting.
I20260806 10:44:24.617647 6544 log.cc:824] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:24.634268 6544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 10:44:24.634871 6544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49: Bootstrap complete.
I20260806 10:44:24.644032 6544 raft_consensus.cc:348] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } }
I20260806 10:44:24.645162 6544 raft_consensus.cc:729] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d57c9922853b447ba0ae398aff1cbc49, State: Initialized, Role: FOLLOWER
I20260806 10:44:24.645881 6544 consensus_queue.cc:260] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } }
I20260806 10:44:24.646128 6544 raft_consensus.cc:388] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:44:24.646251 6544 raft_consensus.cc:482] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:44:24.646449 6544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 2 FOLLOWER]: Advancing to term 3
I20260806 10:44:24.650332 6544 raft_consensus.cc:504] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } }
I20260806 10:44:24.650851 6544 leader_election.cc:302] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d57c9922853b447ba0ae398aff1cbc49; no voters:
I20260806 10:44:24.651485 6544 leader_election.cc:288] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 10:44:24.651628 6548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 10:44:24.652712 6548 raft_consensus.cc:686] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [term 3 LEADER]: Becoming Leader. State: Replica: d57c9922853b447ba0ae398aff1cbc49, State: Running, Role: LEADER
I20260806 10:44:24.653291 6548 consensus_queue.cc:237] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } }
I20260806 10:44:24.653656 6544 sys_catalog.cc:564] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:44:24.655936 6551 sys_catalog.cc:455] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d57c9922853b447ba0ae398aff1cbc49. Latest consensus state: current_term: 3 leader_uuid: "d57c9922853b447ba0ae398aff1cbc49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } } }
I20260806 10:44:24.655977 6549 sys_catalog.cc:455] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "d57c9922853b447ba0ae398aff1cbc49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57c9922853b447ba0ae398aff1cbc49" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40301 } } }
I20260806 10:44:24.656318 6551 sys_catalog.cc:458] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:24.656322 6549 sys_catalog.cc:458] T 00000000000000000000000000000000 P d57c9922853b447ba0ae398aff1cbc49 [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:24.657435 6560 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:44:24.666949 6560 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:44:24.668462 6560 catalog_manager.cc:1259] Loaded cluster ID: 8aab229fa6cd49fa937c0283ed4263ac
I20260806 10:44:24.668562 6560 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 10:44:24.670677 6560 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fbcc6d929ad google::LogMessage::Fail() at ??:0
@ 0x7fbcc6d9588a google::LogMessage::SendToLog() at ??:0
@ 0x7fbcc6d924de google::LogMessage::Flush() at ??:0
@ 0x7fbcc6d93a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fbcdc7c5512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fbcdc7c2976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fbcdc84a610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fbcdc84a439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fbcc99de345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fbcc99e191c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fbcc99e1799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fbcc99bceaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fbcccc966db start_thread at ??:0
@ 0x7fbcc5c2c61f clone at ??:0
W20260806 10:44:25.003950 6546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:25.004249 6546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:25.004348 6546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:25.011976 6546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:25.012102 6546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:25.012220 6546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:44:25.022594 6546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:35101
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=43395
--tserver_master_addrs=127.16.45.126:40301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:25.023984 6546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:25.025385 6546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:25.039119 6616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:25.039180 6618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:25.039428 6615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:25.040488 6546 server_base.cc:1034] running on GCE node
I20260806 10:44:25.041183 6546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:25.042241 6546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:25.043509 6546 hybrid_clock.cc:648] HybridClock initialized: now 1786013065043459 us; error 34 us; skew 500 ppm
I20260806 10:44:25.043882 6546 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:25 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013065, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:25.050571 6546 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:44:25.052274 6546 webserver.cc:460] Webserver started at http://127.16.45.65:43395/ using document root <none> and password file <none>
I20260806 10:44:25.053040 6546 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:25.053166 6546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:25.059240 6546 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 10:44:25.066557 6628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:25.068555 6546 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260806 10:44:25.068790 6546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "1505955c02a7476a8a5ed8f60ebb1d9e"
format_stamp: "Formatted at 2026-08-06 10:44:19 on dist-test-slave-fgb3"
server_key: "c9d25c781753fac692e3b12c28818032"
server_key_iv: "55842fda7b659df5572f03910567df92"
server_key_version: "encryptionkey@0"
I20260806 10:44:25.070343 6546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:25.099233 6546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:25.103612 6546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:25.103855 6546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:25.104889 6546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:25.106927 6637 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260806 10:44:25.112686 6637 ts_tablet_manager.cc:1852] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260806 10:44:25.113759 6637 ts_tablet_manager.cc:1905] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:25.121721 6637 ts_tablet_manager.cc:1918] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:44:25.121925 6637 log.cc:1196] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/f007320237684befa55d0689bb61c473
I20260806 10:44:25.122509 6637 ts_tablet_manager.cc:1939] T f007320237684befa55d0689bb61c473 P 1505955c02a7476a8a5ed8f60ebb1d9e: Deleting consensus metadata
I20260806 10:44:25.122927 6546 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260806 10:44:25.123062 6546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.017s user 0.000s sys 0.000s
I20260806 10:44:25.123174 6546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:25.123240 6546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:25.155449 6546 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:35101
I20260806 10:44:25.155548 6781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:35101 every 8 connection(s)
I20260806 10:44:25.157104 6546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:44:25.163173 6786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:25.160713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:52201)
0806 10:44:25.161647 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:25.161959 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":349,"threads_started":1}
W20260806 10:44:25.163923 6784 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:40301 (0 consecutive failures): Network error: Failed to ping master at 127.16.45.126:40301: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
I20260806 10:44:25.164870 6786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:25.164480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:51985)
0806 10:44:25.164646 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:25.164735 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 10:44:25.165884 6786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:25.165479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:51585)
0806 10:44:25.165631 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:25.165727 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 10:44:25.166301 6784 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 10:44:25.166617 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 6546
I20260806 10:44:25.167214 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:42457
--local_ip_for_outbound_sockets=127.16.45.66
--tserver_master_addrs=127.16.45.126:40301
--webserver_port=32781
--webserver_interface=127.16.45.66
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:25.510186 6787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:25.510492 6787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:25.510630 6787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:25.517853 6787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:25.518006 6787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:25.518157 6787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:44:25.528275 6787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:42457
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=32781
--tserver_master_addrs=127.16.45.126:40301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:25.529745 6787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:25.531069 6787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:25.543994 6798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:25.544040 6795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:25.544068 6794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:25.545142 6787 server_base.cc:1034] running on GCE node
I20260806 10:44:25.545737 6787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:25.546777 6787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:25.547976 6787 hybrid_clock.cc:648] HybridClock initialized: now 1786013065547910 us; error 65 us; skew 500 ppm
I20260806 10:44:25.548274 6787 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:25 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013065, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:25.551374 6787 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:44:25.552790 6787 webserver.cc:460] Webserver started at http://127.16.45.66:32781/ using document root <none> and password file <none>
I20260806 10:44:25.553457 6787 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:25.553562 6787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:25.558895 6787 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:44:25.561738 6808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:25.563246 6787 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:44:25.563392 6787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "d45063ac5e0540af8e3607d3ea99c96e"
format_stamp: "Formatted at 2026-08-06 10:44:19 on dist-test-slave-fgb3"
server_key: "b1e52fc668b13a6b4214f83579a53b52"
server_key_iv: "db62597d2a337f57a2c343c35195c1ea"
server_key_version: "encryptionkey@0"
I20260806 10:44:25.564373 6787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:25.578929 6787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:25.583253 6787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:25.583498 6787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:25.584548 6787 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:25.585925 6787 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:25.586011 6787 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:25.586091 6787 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:25.586145 6787 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:25.617862 6787 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:42457
I20260806 10:44:25.617918 6963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:42457 every 8 connection(s)
I20260806 10:44:25.619663 6787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:44:25.620639 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 6787
I20260806 10:44:25.621462 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:33289
--local_ip_for_outbound_sockets=127.16.45.67
--tserver_master_addrs=127.16.45.126:40301
--webserver_port=35823
--webserver_interface=127.16.45.67
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:44:25.625355 6966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:25.623103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:42393)
0806 10:44:25.623979 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:25.624234 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":324,"threads_started":1}
W20260806 10:44:25.626114 6964 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:40301 (0 consecutive failures): Network error: Failed to ping master at 127.16.45.126:40301: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
I20260806 10:44:25.627063 6966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:25.626689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:43657)
0806 10:44:25.626848 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:25.626936 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 10:44:25.627950 6966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:25.627612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:41963)
0806 10:44:25.627742 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:25.627830 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 10:44:25.628180 6964 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 10:44:25.954604 6969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:25.954897 6969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:25.955024 6969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:25.962494 6969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:25.962617 6969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:25.962769 6969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:44:25.972590 6969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:33289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=35823
--tserver_master_addrs=127.16.45.126:40301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:25.973897 6969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:25.975207 6969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:25.987958 6976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:25.987883 6978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:25.987929 6980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:25.988744 6969 server_base.cc:1034] running on GCE node
I20260806 10:44:25.989326 6969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:25.990185 6969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:25.991376 6969 hybrid_clock.cc:648] HybridClock initialized: now 1786013065991320 us; error 46 us; skew 500 ppm
I20260806 10:44:25.991675 6969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:25 dist-test-slave-fgb3 krb5kdc[4915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013065, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:25.994836 6969 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:44:25.996263 6969 webserver.cc:460] Webserver started at http://127.16.45.67:35823/ using document root <none> and password file <none>
I20260806 10:44:25.996995 6969 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:25.997107 6969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:26.002693 6969 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 10:44:26.005542 6988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:26.007032 6969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:44:26.007198 6969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "8bf2a423e80641b58a3340bc726bfabb"
format_stamp: "Formatted at 2026-08-06 10:44:20 on dist-test-slave-fgb3"
server_key: "8fee5a217269e1a4119731b1b5d314d1"
server_key_iv: "13e9480093e10791e4ba0e749b5487f5"
server_key_version: "encryptionkey@0"
I20260806 10:44:26.008184 6969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:26.026371 6969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:26.031038 6969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:26.031311 6969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:26.032354 6969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:26.033788 6969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:26.033893 6969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:26.034013 6969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:26.034090 6969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:26.066015 6969 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:33289
I20260806 10:44:26.066092 7153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:33289 every 8 connection(s)
I20260806 10:44:26.067502 6969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:44:26.070474 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 6969
I20260806 10:44:26.072440 7156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:26.070438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:60553)
0806 10:44:26.071232 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:26.071503 (+ 271us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":312,"threads_started":1}
W20260806 10:44:26.073041 7154 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:40301 (0 consecutive failures): Network error: Failed to ping master at 127.16.45.126:40301: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
I20260806 10:44:26.073779 7156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:26.073489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:34271)
0806 10:44:26.073614 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:26.073678 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 10:44:26.074599 7156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:26.074283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:39245)
0806 10:44:26.074423 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:26.074496 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260806 10:44:26.074800 7154 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 10:44:26.167943 7161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:26.166934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:54465)
0806 10:44:26.167554 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:26.167670 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":222,"threads_started":1}
I20260806 10:44:26.629786 7162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:26.628918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:42871)
0806 10:44:26.629430 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:26.629554 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":232,"threads_started":1}
I20260806 10:44:27.076332 7163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:27.075423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:39025)
0806 10:44:27.075945 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:27.076092 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":247,"threads_started":1}
I20260806 10:44:27.169533 7164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:27.168869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:48667)
0806 10:44:27.169286 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:27.169375 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":216,"threads_started":1}
I20260806 10:44:27.631556 7165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:27.630804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:53105)
0806 10:44:27.631290 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:27.631380 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":239,"threads_started":1}
I20260806 10:44:28.078012 7168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:28.077284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:54869)
0806 10:44:28.077745 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:28.077826 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":231,"threads_started":1}
I20260806 10:44:28.171221 7170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:28.170441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:36641)
0806 10:44:28.170945 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:28.171039 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":243,"threads_started":1}
I20260806 10:44:28.633186 7173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:28.632457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:42543)
0806 10:44:28.632912 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:28.633005 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":233,"threads_started":1}
I20260806 10:44:29.079816 7174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:29.079033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:51323)
0806 10:44:29.079551 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:29.079640 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":279,"threads_started":1}
I20260806 10:44:29.172925 7175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:29.172168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:50753)
0806 10:44:29.172658 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:29.172747 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":246,"threads_started":1}
I20260806 10:44:29.634943 7176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:29.634152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:56465)
0806 10:44:29.634654 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:29.634740 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":276,"threads_started":1}
I20260806 10:44:30.081707 7177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:30.080778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:49299)
0806 10:44:30.081332 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:30.081443 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":258,"threads_started":1}
I20260806 10:44:30.174736 7178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:30.173935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:42387)
0806 10:44:30.174452 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:30.174540 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":236,"threads_started":1}
I20260806 10:44:30.636790 7179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:30.635919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:46929)
0806 10:44:30.636494 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:30.636592 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":277,"threads_started":1}
I20260806 10:44:31.083510 7180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:31.082730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:53895)
0806 10:44:31.083211 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:31.083300 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":241,"threads_started":1}
I20260806 10:44:31.176555 7181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:31.175795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:42251)
0806 10:44:31.176265 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:31.176377 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":238,"threads_started":1}
I20260806 10:44:31.638803 7183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:31.637900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:55385)
0806 10:44:31.638518 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:31.638627 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":295,"threads_started":1}
I20260806 10:44:32.085391 7184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:32.084571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:38367)
0806 10:44:32.085105 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:32.085212 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":275,"threads_started":1}
I20260806 10:44:32.178519 7185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:32.177508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:44491)
0806 10:44:32.178163 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:32.178250 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":312,"threads_started":1}
I20260806 10:44:32.640739 7187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:32.639844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:36533)
0806 10:44:32.640424 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:32.640518 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":263,"threads_started":1}
I20260806 10:44:33.087340 7190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:33.086508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:43793)
0806 10:44:33.087026 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:33.087116 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":213,"threads_started":1}
I20260806 10:44:33.180116 7191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:33.179394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:46099)
0806 10:44:33.179845 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:33.179947 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":226,"threads_started":1}
I20260806 10:44:33.642710 7192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:33.641822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:51351)
0806 10:44:33.642448 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:33.642532 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":270,"threads_started":1}
I20260806 10:44:34.089112 7193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:34.088383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:54901)
0806 10:44:34.088862 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:34.088944 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":254,"threads_started":1}
I20260806 10:44:34.181782 7196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:34.181003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:43297)
0806 10:44:34.181505 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:34.181607 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":251,"threads_started":1}
I20260806 10:44:34.644439 7197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:34.643646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:39187)
0806 10:44:34.644173 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:34.644260 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":273,"threads_started":1}
I20260806 10:44:35.090976 7198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:35.090066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:40503)
0806 10:44:35.090635 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:35.090739 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":277,"threads_started":1}
I20260806 10:44:35.183498 7199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:35.182745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:38305)
0806 10:44:35.183202 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:35.183324 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":229,"threads_started":1}
I20260806 10:44:35.646075 7200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:35.645366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:51375)
0806 10:44:35.645822 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:35.645905 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":237,"threads_started":1}
I20260806 10:44:36.092734 7202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:36.091966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:37613)
0806 10:44:36.092472 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:36.092566 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":271,"threads_started":1}
I20260806 10:44:36.185348 7203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:36.184449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:38959)
0806 10:44:36.185004 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:36.185101 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":284,"threads_started":1}
I20260806 10:44:36.647851 7204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:36.647118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:55345)
0806 10:44:36.647563 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:36.647663 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":213,"threads_started":1}
I20260806 10:44:37.094601 7205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:37.093741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:57353)
0806 10:44:37.094280 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:37.094414 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":298,"threads_started":1}
I20260806 10:44:37.187323 7206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:37.186475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:41063)
0806 10:44:37.187052 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:37.187158 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":298,"threads_started":1}
I20260806 10:44:37.649546 7207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:37.648840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:57275)
0806 10:44:37.649291 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:37.649374 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":229,"threads_started":1}
I20260806 10:44:38.096254 7208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:38.095523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:47261)
0806 10:44:38.095988 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:38.096090 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":227,"threads_started":1}
I20260806 10:44:38.188984 7210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:38.188217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:36993)
0806 10:44:38.188678 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:38.188787 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":245,"threads_started":1}
I20260806 10:44:38.651350 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:38.650536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:40985)
0806 10:44:38.651052 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:38.651152 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":246,"threads_started":1}
I20260806 10:44:39.098235 7212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:39.097372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:45609)
0806 10:44:39.097918 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:39.098043 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":266,"threads_started":1}
I20260806 10:44:39.190807 7213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:39.189999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:40393)
0806 10:44:39.190523 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:39.190618 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":246,"threads_started":1}
I20260806 10:44:39.653244 7214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:39.652448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:44877)
0806 10:44:39.652962 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:39.653054 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":259,"threads_started":1}
I20260806 10:44:40.100100 7215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:40.099254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:34889)
0806 10:44:40.099774 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:40.099861 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":269,"threads_started":1}
I20260806 10:44:40.192914 7217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:40.192078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.65:43089)
0806 10:44:40.192604 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:40.192726 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":238,"threads_started":1}
I20260806 10:44:40.655197 7218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:40.654447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.66:57369)
0806 10:44:40.654913 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:40.655003 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":222,"threads_started":1}
I20260806 10:44:41.081619 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 6546
I20260806 10:44:41.100148 7219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:41.082930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59862 (local address 127.16.45.65:35101)
0806 10:44:41.083527 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:41.083543 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:41.083584 (+ 41us) server_negotiation.cc:407] Connection header received
0806 10:44:41.085312 (+ 1728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:41.085323 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:41.085773 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:41.086093 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:41.087901 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:41.089237 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:41.090619 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:41.091324 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:41.091475 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:41.094115 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:41.094123 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:41.094139 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:41.094182 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:41.096957 (+ 2775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:41.097642 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:41.097649 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:41.097656 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:41.097820 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:41.098162 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:41.098165 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:41.098167 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:41.098744 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:41.099004 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:41.099426 (+ 422us) server_negotiation.cc:299] Negotiation successful
0806 10:44:41.099830 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":264,"threads_started":1}
I20260806 10:44:41.101673 6775 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:41.101980 7220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:41.101199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40301 (local address 127.16.45.67:33351)
0806 10:44:41.101680 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:41.101800 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":255,"threads_started":1}
I20260806 10:44:41.187227 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 6546
I20260806 10:44:41.211555 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 6787
I20260806 10:44:41.229101 7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:41.212605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53494 (local address 127.16.45.66:42457)
0806 10:44:41.213222 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:41.213236 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:41.213275 (+ 39us) server_negotiation.cc:407] Connection header received
0806 10:44:41.215092 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:41.215101 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:41.215569 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:41.215856 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:41.217288 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:41.218656 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:41.219904 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:41.220577 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:41.220710 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:41.223372 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:41.223381 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:41.223397 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:41.223452 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:41.226200 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:41.226912 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:41.226918 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:41.226925 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:41.227093 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:41.227374 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:41.227377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:41.227379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:41.227886 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:41.228125 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:41.228468 (+ 343us) server_negotiation.cc:299] Negotiation successful
0806 10:44:41.228804 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":343,"threads_started":1}
I20260806 10:44:41.230510 6958 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:41.315650 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 6787
I20260806 10:44:41.338889 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 6969
I20260806 10:44:41.356945 7224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:41.339888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59212 (local address 127.16.45.67:33289)
0806 10:44:41.340508 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:41.340522 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:41.340568 (+ 46us) server_negotiation.cc:407] Connection header received
0806 10:44:41.342229 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:41.342240 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:41.342743 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:41.343071 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:41.344524 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:41.345733 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:41.347059 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:41.347718 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:41.347893 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:41.350532 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:41.350543 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:41.350564 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:41.350614 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:41.353494 (+ 2880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:41.354167 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:41.354176 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:41.354182 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:41.354523 (+ 341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:41.354888 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:41.354893 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:41.354897 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:41.355453 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:41.355743 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:41.356199 (+ 456us) server_negotiation.cc:299] Negotiation successful
0806 10:44:41.356634 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":278,"threads_started":1}
I20260806 10:44:41.358408 7147 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:41.441675 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 6969
2026-08-06T10:44:41Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24561 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:44:41 dist-test-slave-fgb3 krb5kdc[7231](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:44:41 dist-test-slave-fgb3 krb5kdc[7231](info): set up 2 sockets
Aug 06 10:44:41 dist-test-slave-fgb3 krb5kdc[7231](info): commencing operation
krb5kdc: starting...
W20260806 10:44:42.650039 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:44:42 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:44:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:44:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:44:42.937826 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40843
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:40843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:43.282656 7257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:43.282967 7257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:43.283100 7257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:43.290457 7257 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 10:44:43.290570 7257 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 10:44:43.290635 7257 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 10:44:43.290704 7257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:44:43.290787 7257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:43.290884 7257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:43.290947 7257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:44:43.291024 7257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:44:43.301518 7257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:40843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:43.302911 7257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:43.304272 7257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:43.317334 7263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:43.317693 7265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:43.317375 7262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:43.319340 7257 server_base.cc:1034] running on GCE node
I20260806 10:44:43.320220 7257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:43.321728 7257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:43.322963 7257 hybrid_clock.cc:648] HybridClock initialized: now 1786013083322903 us; error 37 us; skew 500 ppm
I20260806 10:44:43.323303 7257 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:43 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013083, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:43.326532 7257 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:44:43.328037 7257 webserver.cc:460] Webserver started at http://127.16.45.126:32777/ using document root <none> and password file <none>
I20260806 10:44:43.328749 7257 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:43.328853 7257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:43.329159 7257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:44:43.332257 7257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "6cc1f5b2fa994fd3a370a11240927d2d"
format_stamp: "Formatted at 2026-08-06 10:44:43 on dist-test-slave-fgb3"
server_key: "2bcec39d4b61cc2dd648ce2cd22bea6d"
server_key_iv: "a730f6eade5581a1de9136927db4eb00"
server_key_version: "encryptionkey@0"
I20260806 10:44:43.333209 7257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "6cc1f5b2fa994fd3a370a11240927d2d"
format_stamp: "Formatted at 2026-08-06 10:44:43 on dist-test-slave-fgb3"
server_key: "2bcec39d4b61cc2dd648ce2cd22bea6d"
server_key_iv: "a730f6eade5581a1de9136927db4eb00"
server_key_version: "encryptionkey@0"
I20260806 10:44:43.338654 7257 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 10:44:43.342072 7279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:43.343405 7257 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:44:43.343606 7257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "6cc1f5b2fa994fd3a370a11240927d2d"
format_stamp: "Formatted at 2026-08-06 10:44:43 on dist-test-slave-fgb3"
server_key: "2bcec39d4b61cc2dd648ce2cd22bea6d"
server_key_iv: "a730f6eade5581a1de9136927db4eb00"
server_key_version: "encryptionkey@0"
I20260806 10:44:43.343808 7257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:43.360606 7257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:43.364733 7257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:43.364990 7257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:43.383033 7257 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:40843
I20260806 10:44:43.383054 7359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:40843 every 8 connection(s)
I20260806 10:44:43.384389 7257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:44:43.386003 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 7257
I20260806 10:44:43.386215 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:44:43.386917 16565 external_mini_cluster.cc:1428] Setting key 01e4e9b7614be607fc62e406f801c047
I20260806 10:44:43.388569 7360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 10:44:43 dist-test-slave-fgb3 krb5kdc[7231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:43.401850 7360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Bootstrap starting.
I20260806 10:44:43.405328 7360 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:43.406497 7360 log.cc:824] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:43.409807 7360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: No bootstrap required, opened a new log
I20260806 10:44:43.410565 7364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:43.388833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40540 (local address 127.16.45.126:40843)
0806 10:44:43.389589 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:43.389604 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:43.389654 (+ 50us) server_negotiation.cc:407] Connection header received
0806 10:44:43.391739 (+ 2085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:43.391767 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:43.392262 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:43.392710 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:43.394112 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:43.396173 (+ 2061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:43.397601 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:43.398774 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:43.398968 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:43.403213 (+ 4245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:43.403221 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:43.403235 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:43.403281 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:43.406285 (+ 3004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:43.407270 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:43.407278 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:43.407288 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:43.407519 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:43.407885 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:43.407890 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:43.407894 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:43.408399 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:43.408611 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:43.409094 (+ 483us) server_negotiation.cc:299] Negotiation successful
0806 10:44:43.409420 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":296,"threads_started":1}
I20260806 10:44:43.417999 7360 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } }
I20260806 10:44:43.418375 7360 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:43.418465 7360 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc1f5b2fa994fd3a370a11240927d2d, State: Initialized, Role: FOLLOWER
I20260806 10:44:43.419008 7360 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } }
I20260806 10:44:43.419219 7360 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:44:43.419314 7360 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:44:43.419445 7360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:43.421554 7360 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } }
I20260806 10:44:43.422020 7360 leader_election.cc:302] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cc1f5b2fa994fd3a370a11240927d2d; no voters:
I20260806 10:44:43.422613 7360 leader_election.cc:288] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:44:43.422727 7366 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:44:43.423761 7366 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 1 LEADER]: Becoming Leader. State: Replica: 6cc1f5b2fa994fd3a370a11240927d2d, State: Running, Role: LEADER
I20260806 10:44:43.424340 7366 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } }
I20260806 10:44:43.424755 7360 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:44:43.426784 7369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc1f5b2fa994fd3a370a11240927d2d. Latest consensus state: current_term: 1 leader_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } } }
I20260806 10:44:43.427124 7369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:43.427670 7368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } } }
I20260806 10:44:43.427970 7368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: This master's current role is: LEADER
I20260806 10:44:43.428138 7374 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:44:43.433981 7374 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:44:43.443557 7374 catalog_manager.cc:1347] Generated new cluster ID: 9d21909fb5934d7d9f0c16f5d1ab0285
I20260806 10:44:43.443691 7374 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:44:43.456164 7374 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:44:43.457476 7374 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:44:43.466032 7374 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Generated new TSK 0
I20260806 10:44:43.466931 7374 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:44:43.552274 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:40843
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:43.919116 7399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:43.919404 7399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:43.919508 7399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:43.926934 7399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:43.927055 7399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:43.927178 7399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:44:43.937232 7399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:43.938599 7399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:43.939879 7399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:43.953197 7406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:43.953263 7405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:43.953873 7399 server_base.cc:1034] running on GCE node
W20260806 10:44:43.954108 7408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:43.954842 7399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:43.955794 7399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:43.957015 7399 hybrid_clock.cc:648] HybridClock initialized: now 1786013083956958 us; error 48 us; skew 500 ppm
I20260806 10:44:43.957377 7399 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:43 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013083, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:43.960557 7399 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:44:43.962005 7399 webserver.cc:460] Webserver started at http://127.16.45.65:44221/ using document root <none> and password file <none>
I20260806 10:44:43.962736 7399 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:43.962858 7399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:43.963160 7399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:44:43.966432 7399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "327b0d9951404af28e2c36263739298d"
format_stamp: "Formatted at 2026-08-06 10:44:43 on dist-test-slave-fgb3"
server_key: "dafb22bfd080ab91613d6cc377f04cf3"
server_key_iv: "f372ee18bb8bdd98934a103832edf08e"
server_key_version: "encryptionkey@0"
I20260806 10:44:43.967203 7399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "327b0d9951404af28e2c36263739298d"
format_stamp: "Formatted at 2026-08-06 10:44:43 on dist-test-slave-fgb3"
server_key: "dafb22bfd080ab91613d6cc377f04cf3"
server_key_iv: "f372ee18bb8bdd98934a103832edf08e"
server_key_version: "encryptionkey@0"
I20260806 10:44:43.972595 7399 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260806 10:44:43.976310 7420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:43.977658 7399 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:44:43.977847 7399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "327b0d9951404af28e2c36263739298d"
format_stamp: "Formatted at 2026-08-06 10:44:43 on dist-test-slave-fgb3"
server_key: "dafb22bfd080ab91613d6cc377f04cf3"
server_key_iv: "f372ee18bb8bdd98934a103832edf08e"
server_key_version: "encryptionkey@0"
I20260806 10:44:43.978114 7399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:43.998502 7399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:44.002662 7399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:44.002939 7399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:44.003917 7399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:44.005244 7399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:44.005326 7399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:44.005448 7399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:44.005502 7399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:44.037382 7399 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:42333
I20260806 10:44:44.037433 7591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:42333 every 8 connection(s)
I20260806 10:44:44.038800 7399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:44:44.049175 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 7399
I20260806 10:44:44.049399 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:44:44.050135 16565 external_mini_cluster.cc:1428] Setting key f0d10895faaa81bb4b1746e95dda66d9
Aug 06 10:44:44 dist-test-slave-fgb3 krb5kdc[7231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013083, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:44.059013 7598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:44.041532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:55733 (local address 127.16.45.126:40843)
0806 10:44:44.041998 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:44.042003 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:44.042951 (+ 948us) server_negotiation.cc:407] Connection header received
0806 10:44:44.044812 (+ 1861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:44.044818 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:44.044906 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:44.045004 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:44.046536 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:44.047263 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:44.048814 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:44.049225 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:44.049341 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:44.052911 (+ 3570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:44.052918 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:44.052922 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:44.052961 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:44.055939 (+ 2978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:44.056712 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:44.056717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:44.056720 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:44.056874 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:44.057247 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:44.057251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:44.057254 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:44.057586 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:44.057726 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:44.058433 (+ 707us) server_negotiation.cc:299] Negotiation successful
0806 10:44:44.058661 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":228,"threads_started":1}
I20260806 10:44:44.059864 7599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:44.042033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:55733)
0806 10:44:44.042783 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:44.042821 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:44.044540 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:44.045260 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:44.045269 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:44.045787 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:44.046367 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:44.046384 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:44.047425 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:44.047429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:44.048673 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:44.048686 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:44.049463 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:44.049470 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:44.049690 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:44.050367 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:44.050400 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:44.052684 (+ 2284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:44.056072 (+ 3388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:44.056079 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:44.056093 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:44.056581 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:44.056963 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:44.056966 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:44.056968 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:44.057146 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:44.057689 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:44.057694 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:44.058031 (+ 337us) client_negotiation.cc:769] Sending connection context
0806 10:44:44.058262 (+ 231us) client_negotiation.cc:240] Negotiation successful
0806 10:44:44.058712 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":324,"threads_started":1}
I20260806 10:44:44.061329 7593 heartbeater.cc:347] Connected to a master server at 127.16.45.126:40843
I20260806 10:44:44.061645 7593 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:44.062381 7593 heartbeater.cc:511] Master 127.16.45.126:40843 requested a full tablet report, sending...
I20260806 10:44:44.064409 7307 ts_manager.cc:194] Registered new tserver with Master: 327b0d9951404af28e2c36263739298d (127.16.45.65:42333)
I20260806 10:44:44.065843 7307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:55733
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:44:44.112669 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:40843
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:44.450758 7602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:44.451052 7602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:44.451146 7602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:44.458421 7602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:44.458550 7602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:44.458707 7602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:44:44.468569 7602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:44.470009 7602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:44.471421 7602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:44.484944 7609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:44.485011 7615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:44.485033 7611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:44.486004 7602 server_base.cc:1034] running on GCE node
I20260806 10:44:44.486625 7602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:44.487504 7602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:44.488705 7602 hybrid_clock.cc:648] HybridClock initialized: now 1786013084488650 us; error 48 us; skew 500 ppm
I20260806 10:44:44.489010 7602 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:44 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013084, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:44.496450 7602 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:44:44.498135 7602 webserver.cc:460] Webserver started at http://127.16.45.66:36011/ using document root <none> and password file <none>
I20260806 10:44:44.498881 7602 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:44.499007 7602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:44.499315 7602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:44:44.502224 7602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "4556271ef0df4923b9550a3ee709cfef"
format_stamp: "Formatted at 2026-08-06 10:44:44 on dist-test-slave-fgb3"
server_key: "638cc8f70f7e706486a5b402fadbcfca"
server_key_iv: "eeea66ec3f8639a82616a0574eb8616e"
server_key_version: "encryptionkey@0"
I20260806 10:44:44.503018 7602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "4556271ef0df4923b9550a3ee709cfef"
format_stamp: "Formatted at 2026-08-06 10:44:44 on dist-test-slave-fgb3"
server_key: "638cc8f70f7e706486a5b402fadbcfca"
server_key_iv: "eeea66ec3f8639a82616a0574eb8616e"
server_key_version: "encryptionkey@0"
I20260806 10:44:44.508117 7602 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:44:44.511560 7625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:44.512821 7602 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:44:44.512992 7602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "4556271ef0df4923b9550a3ee709cfef"
format_stamp: "Formatted at 2026-08-06 10:44:44 on dist-test-slave-fgb3"
server_key: "638cc8f70f7e706486a5b402fadbcfca"
server_key_iv: "eeea66ec3f8639a82616a0574eb8616e"
server_key_version: "encryptionkey@0"
I20260806 10:44:44.513175 7602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:44.526471 7602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:44.530578 7602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:44.530846 7602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:44.531742 7602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:44.532998 7602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:44.533077 7602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:44.533198 7602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:44.533257 7602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:44.564442 7602 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:33381
I20260806 10:44:44.564468 7801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:33381 every 8 connection(s)
I20260806 10:44:44.565845 7602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:44:44.570638 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 7602
I20260806 10:44:44.570844 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:44:44.571347 16565 external_mini_cluster.cc:1428] Setting key 49a6e2dd25545a4eac8f9e28d0f1e5e0
Aug 06 10:44:44 dist-test-slave-fgb3 krb5kdc[7231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013084, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:44.585788 7805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:44.568453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:54635 (local address 127.16.45.126:40843)
0806 10:44:44.568875 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:44.568880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:44.569776 (+ 896us) server_negotiation.cc:407] Connection header received
0806 10:44:44.571685 (+ 1909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:44.571691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:44.571771 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:44.571875 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:44.573345 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:44.574059 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:44.575632 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:44.576076 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:44.576186 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:44.580158 (+ 3972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:44.580163 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:44.580166 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:44.580199 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:44.582731 (+ 2532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:44.583440 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:44.583444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:44.583447 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:44.583580 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:44.584002 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:44.584006 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:44.584008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:44.584281 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:44.584423 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:44.585308 (+ 885us) server_negotiation.cc:299] Negotiation successful
0806 10:44:44.585493 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":215,"threads_started":1}
I20260806 10:44:44.586994 7806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:44.568880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:54635)
0806 10:44:44.569620 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:44.569658 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:44.571393 (+ 1735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:44.572117 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:44.572126 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:44.572629 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:44.573177 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:44.573194 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:44.574198 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:44.574203 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:44.575491 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:44.575504 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:44.576310 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:44.576319 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:44.576534 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:44.577191 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:44.577213 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:44.579913 (+ 2700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:44.582886 (+ 2973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:44.582895 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:44.582912 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:44.583318 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:44.583683 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:44.583688 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:44.583692 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:44.583887 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:44.584409 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:44.584417 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:44.584836 (+ 419us) client_negotiation.cc:769] Sending connection context
0806 10:44:44.585127 (+ 291us) client_negotiation.cc:240] Negotiation successful
0806 10:44:44.585671 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":284,"threads_started":1}
I20260806 10:44:44.588476 7802 heartbeater.cc:347] Connected to a master server at 127.16.45.126:40843
I20260806 10:44:44.588792 7802 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:44.589526 7802 heartbeater.cc:511] Master 127.16.45.126:40843 requested a full tablet report, sending...
I20260806 10:44:44.591027 7307 ts_manager.cc:194] Registered new tserver with Master: 4556271ef0df4923b9550a3ee709cfef (127.16.45.66:33381)
I20260806 10:44:44.591821 7307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:54635
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:44:44.633829 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:40843
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:44:44.971566 7811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:44:44.971871 7811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:44:44.972025 7811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:44:44.979411 7811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:44:44.979552 7811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:44:44.979714 7811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:44:44.989660 7811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:44:44.990970 7811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:44:44.992300 7811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:44:45.005843 7821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:45.005915 7818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:44:45.005890 7817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:44:45.006673 7811 server_base.cc:1034] running on GCE node
I20260806 10:44:45.007372 7811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:44:45.008390 7811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:44:45.009591 7811 hybrid_clock.cc:648] HybridClock initialized: now 1786013085009546 us; error 45 us; skew 500 ppm
I20260806 10:44:45.009899 7811 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:44:45 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013085, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:44:45.012980 7811 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:44:45.014446 7811 webserver.cc:460] Webserver started at http://127.16.45.67:32857/ using document root <none> and password file <none>
I20260806 10:44:45.015087 7811 fs_manager.cc:359] Metadata directory not provided
I20260806 10:44:45.015188 7811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:44:45.015450 7811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:44:45.018455 7811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "bf8961e0426b4ce48057444649b1f612"
format_stamp: "Formatted at 2026-08-06 10:44:45 on dist-test-slave-fgb3"
server_key: "6cdabe86a08ce70f3fe9ee6390fd54f1"
server_key_iv: "a2a6f1defc6f7dc68649154b213d5b78"
server_key_version: "encryptionkey@0"
I20260806 10:44:45.019155 7811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "bf8961e0426b4ce48057444649b1f612"
format_stamp: "Formatted at 2026-08-06 10:44:45 on dist-test-slave-fgb3"
server_key: "6cdabe86a08ce70f3fe9ee6390fd54f1"
server_key_iv: "a2a6f1defc6f7dc68649154b213d5b78"
server_key_version: "encryptionkey@0"
I20260806 10:44:45.024202 7811 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 10:44:45.027623 7829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:45.028879 7811 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:44:45.029024 7811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "bf8961e0426b4ce48057444649b1f612"
format_stamp: "Formatted at 2026-08-06 10:44:45 on dist-test-slave-fgb3"
server_key: "6cdabe86a08ce70f3fe9ee6390fd54f1"
server_key_iv: "a2a6f1defc6f7dc68649154b213d5b78"
server_key_version: "encryptionkey@0"
I20260806 10:44:45.029207 7811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:44:45.055265 7811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:44:45.059223 7811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:44:45.059508 7811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:44:45.060554 7811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:44:45.061849 7811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:44:45.061934 7811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:45.062054 7811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:44:45.062107 7811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:44:45.069187 7593 heartbeater.cc:503] Master 127.16.45.126:40843 was elected leader, sending a full tablet report...
I20260806 10:44:45.093827 7811 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:44151
I20260806 10:44:45.093909 7990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:44151 every 8 connection(s)
I20260806 10:44:45.095146 7811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:44:45.101279 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 7811
I20260806 10:44:45.101449 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:44:45.101905 16565 external_mini_cluster.cc:1428] Setting key 46f094ac8aa6cd2515c3c449bad77edb
Aug 06 10:44:45 dist-test-slave-fgb3 krb5kdc[7231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013085, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:44:45.116755 7993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.097684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:45923 (local address 127.16.45.126:40843)
0806 10:44:45.098197 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:45.098201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:45.099128 (+ 927us) server_negotiation.cc:407] Connection header received
0806 10:44:45.100993 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:45.101000 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:45.101080 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:45.101179 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:45.102788 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.103663 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.105494 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.105880 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.105988 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.109308 (+ 3320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:45.109314 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:45.109319 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:45.109360 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:45.112704 (+ 3344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:45.113611 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:45.113617 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:45.113621 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:45.113748 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:45.114243 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:45.114268 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:45.114271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:45.114639 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:45.114793 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:45.116240 (+ 1447us) server_negotiation.cc:299] Negotiation successful
0806 10:44:45.116424 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":257,"threads_started":1}
I20260806 10:44:45.118431 7994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.098241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:45923)
0806 10:44:45.098967 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:45.099012 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:45.100704 (+ 1692us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:45.101448 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:45.101457 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:45.102011 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:44:45.102622 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:45.102639 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.103812 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.103816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:45.105353 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:45.105371 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.106090 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.106097 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:45.106350 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.106980 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:44:45.107002 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:44:45.109092 (+ 2090us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:44:45.112869 (+ 3777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:45.112879 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:45.112896 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:45.113482 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:45.113851 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:44:45.113856 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:44:45.113860 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:44:45.114122 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:44:45.114774 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:44:45.114782 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:44:45.115214 (+ 432us) client_negotiation.cc:769] Sending connection context
0806 10:44:45.115487 (+ 273us) client_negotiation.cc:240] Negotiation successful
0806 10:44:45.115956 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":268,"threads_started":1}
I20260806 10:44:45.120144 7991 heartbeater.cc:347] Connected to a master server at 127.16.45.126:40843
I20260806 10:44:45.120456 7991 heartbeater.cc:464] Registering TS with master...
I20260806 10:44:45.121167 7991 heartbeater.cc:511] Master 127.16.45.126:40843 requested a full tablet report, sending...
I20260806 10:44:45.122615 7307 ts_manager.cc:194] Registered new tserver with Master: bf8961e0426b4ce48057444649b1f612 (127.16.45.67:44151)
I20260806 10:44:45.123414 7307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:45923
I20260806 10:44:45.131649 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:44:45.148967 7993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.136415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60934 (local address 127.16.45.126:40843)
0806 10:44:45.136640 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:45.136647 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:45.137025 (+ 378us) server_negotiation.cc:407] Connection header received
0806 10:44:45.137172 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:45.137176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:45.137244 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:45.137316 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:45.138773 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.139532 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.140958 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.141358 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.141461 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.143851 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:45.143857 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:45.143861 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:45.143900 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:45.146483 (+ 2583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:45.147137 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:45.147140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:45.147142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:45.147262 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:45.147598 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:45.147602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:45.147604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:45.147959 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:45.148137 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:45.148446 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 10:44:45.148641 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 10:44:45.153167 7307 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60934:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:44:45.160102 7307 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:44:45.207760 8014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.173364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34400 (local address 127.16.45.66:33381)
0806 10:44:45.196658 (+ 23294us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:45.196671 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:45.199827 (+ 3156us) server_negotiation.cc:407] Connection header received
0806 10:44:45.199935 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:45.199942 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:45.200166 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:45.200333 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:45.201071 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.202661 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.205155 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.206512 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.206636 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.206852 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:45.207137 (+ 285us) server_negotiation.cc:299] Negotiation successful
0806 10:44:45.207432 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23060,"thread_start_us":23310,"threads_started":1}
I20260806 10:44:45.207837 8009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.172838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:33381 (local address 127.0.0.1:34400)
0806 10:44:45.199406 (+ 26568us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:45.199426 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:45.199545 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:45.200350 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:45.200355 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:45.200384 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:45.200785 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:45.200795 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.202796 (+ 2001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.202801 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:45.204926 (+ 2125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:45.204941 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.206697 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.206704 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:45.206901 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.206947 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 10:44:45.207063 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 10:44:45.207353 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26441,"mutex_wait_us":102,"thread_start_us":26278,"threads_started":1}
I20260806 10:44:45.208621 8012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.172678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:42333 (local address 127.0.0.1:47538)
0806 10:44:45.198077 (+ 25399us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:45.198135 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:45.198374 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:45.199540 (+ 1166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:45.199549 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:45.199587 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:45.200729 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:45.200743 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.202857 (+ 2114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.202861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:45.205441 (+ 2580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:45.205462 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.207664 (+ 2202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.207671 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:45.208009 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.208035 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 10:44:45.208102 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 10:44:45.208237 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25072,"mutex_wait_us":155,"thread_start_us":27141,"threads_started":1}
I20260806 10:44:45.208705 8015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.173963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35468 (local address 127.16.45.67:44151)
0806 10:44:45.186477 (+ 12514us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:45.186488 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:45.200296 (+ 13808us) server_negotiation.cc:407] Connection header received
0806 10:44:45.200488 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:45.200495 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:45.200708 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:45.200915 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:45.201590 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.202672 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.205648 (+ 2976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.207133 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.207269 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.207489 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:45.208190 (+ 701us) server_negotiation.cc:299] Negotiation successful
0806 10:44:45.208373 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12282,"thread_start_us":12089,"threads_started":1}
I20260806 10:44:45.208902 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.172899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47538 (local address 127.16.45.65:42333)
0806 10:44:45.197416 (+ 24517us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:45.197426 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:45.198549 (+ 1123us) server_negotiation.cc:407] Connection header received
0806 10:44:45.198679 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:45.198689 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:45.198966 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:45.199188 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:45.200926 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.202668 (+ 1742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.205645 (+ 2977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.207137 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.207262 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.207486 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:45.208418 (+ 932us) server_negotiation.cc:299] Negotiation successful
0806 10:44:45.208589 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24306,"thread_start_us":25837,"threads_started":1}
I20260806 10:44:45.209461 8007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.173321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:44151 (local address 127.0.0.1:35468)
0806 10:44:45.200165 (+ 26844us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:45.200179 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:45.200289 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:45.201044 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:45.201048 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:45.201071 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:45.201426 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:45.201435 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.202907 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.202910 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:45.205481 (+ 2571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:45.205491 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.207681 (+ 2190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.207687 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:45.207918 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.208011 (+ 93us) client_negotiation.cc:769] Sending connection context
0806 10:44:45.208959 (+ 948us) client_negotiation.cc:240] Negotiation successful
0806 10:44:45.209101 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26644,"mutex_wait_us":221,"thread_start_us":24296,"threads_started":1}
I20260806 10:44:45.212332 7898 tablet_service.cc:1467] Processing CreateTablet for tablet beb4009f36954dff972ac2bd6a5fc827 (DEFAULT_TABLE table=test-table [id=d4295aed166241ebbe380f88a6aa87c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:44:45.212339 7703 tablet_service.cc:1467] Processing CreateTablet for tablet beb4009f36954dff972ac2bd6a5fc827 (DEFAULT_TABLE table=test-table [id=d4295aed166241ebbe380f88a6aa87c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:44:45.212339 7490 tablet_service.cc:1467] Processing CreateTablet for tablet beb4009f36954dff972ac2bd6a5fc827 (DEFAULT_TABLE table=test-table [id=d4295aed166241ebbe380f88a6aa87c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:44:45.213662 7898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beb4009f36954dff972ac2bd6a5fc827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:45.213716 7490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beb4009f36954dff972ac2bd6a5fc827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:45.213716 7703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beb4009f36954dff972ac2bd6a5fc827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:44:45.227053 8018 tablet_bootstrap.cc:492] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612: Bootstrap starting.
I20260806 10:44:45.230597 8018 tablet_bootstrap.cc:654] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:45.231701 8019 tablet_bootstrap.cc:492] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef: Bootstrap starting.
I20260806 10:44:45.232235 8018 log.cc:824] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:45.232590 8020 tablet_bootstrap.cc:492] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d: Bootstrap starting.
I20260806 10:44:45.235571 8019 tablet_bootstrap.cc:654] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:45.235749 8020 tablet_bootstrap.cc:654] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d: Neither blocks nor log segments found. Creating new log.
I20260806 10:44:45.235996 8018 tablet_bootstrap.cc:492] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612: No bootstrap required, opened a new log
I20260806 10:44:45.236289 8018 ts_tablet_manager.cc:1397] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.006s
I20260806 10:44:45.236804 8020 log.cc:824] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:45.236860 8019 log.cc:824] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef: Log is configured to *not* fsync() on all Append() calls
I20260806 10:44:45.239882 8020 tablet_bootstrap.cc:492] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d: No bootstrap required, opened a new log
I20260806 10:44:45.240067 8019 tablet_bootstrap.cc:492] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef: No bootstrap required, opened a new log
I20260806 10:44:45.240151 8020 ts_tablet_manager.cc:1397] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 10:44:45.240330 8019 ts_tablet_manager.cc:1397] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 10:44:45.247100 8020 raft_consensus.cc:348] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } } peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } }
I20260806 10:44:45.247507 8020 raft_consensus.cc:374] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:45.247682 8020 raft_consensus.cc:729] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 327b0d9951404af28e2c36263739298d, State: Initialized, Role: FOLLOWER
I20260806 10:44:45.247438 8018 raft_consensus.cc:348] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } } peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } }
I20260806 10:44:45.247843 8018 raft_consensus.cc:374] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:45.247937 8018 raft_consensus.cc:729] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8961e0426b4ce48057444649b1f612, State: Initialized, Role: FOLLOWER
I20260806 10:44:45.248399 8020 consensus_queue.cc:260] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } } peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } }
I20260806 10:44:45.248539 8018 consensus_queue.cc:260] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } } peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } }
I20260806 10:44:45.250279 8020 ts_tablet_manager.cc:1428] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260806 10:44:45.250706 8019 raft_consensus.cc:348] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } } peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } }
I20260806 10:44:45.251158 8019 raft_consensus.cc:374] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:44:45.251295 8019 raft_consensus.cc:729] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4556271ef0df4923b9550a3ee709cfef, State: Initialized, Role: FOLLOWER
I20260806 10:44:45.251914 8019 consensus_queue.cc:260] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } } peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } }
I20260806 10:44:45.253558 7802 heartbeater.cc:503] Master 127.16.45.126:40843 was elected leader, sending a full tablet report...
I20260806 10:44:45.253690 8019 ts_tablet_manager.cc:1428] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef: Time spent starting tablet: real 0.013s user 0.000s sys 0.014s
I20260806 10:44:45.256726 8018 ts_tablet_manager.cc:1428] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612: Time spent starting tablet: real 0.020s user 0.012s sys 0.008s
I20260806 10:44:45.257143 7991 heartbeater.cc:503] Master 127.16.45.126:40843 was elected leader, sending a full tablet report...
I20260806 10:44:45.270982 8027 raft_consensus.cc:482] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:44:45.271279 8027 raft_consensus.cc:504] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } } peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } }
I20260806 10:44:45.272933 8027 leader_election.cc:288] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 327b0d9951404af28e2c36263739298d (127.16.45.65:42333), 4556271ef0df4923b9550a3ee709cfef (127.16.45.66:33381)
I20260806 10:44:45.279466 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.273600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:35699 (local address 127.16.45.65:42333)
0806 10:44:45.273786 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:45.273791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:45.273837 (+ 46us) server_negotiation.cc:407] Connection header received
0806 10:44:45.274085 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:45.274090 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:45.274171 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:45.274266 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:45.274791 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.275882 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.277592 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.278533 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.278699 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.278797 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:45.279070 (+ 273us) server_negotiation.cc:299] Negotiation successful
0806 10:44:45.279201 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:44:45.279492 7994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.273531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:42333 (local address 127.16.45.67:35699)
0806 10:44:45.273757 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:45.273776 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:45.273936 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:45.274362 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:45.274367 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:45.274409 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:45.274610 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:45.274620 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.276014 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.276019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:45.277410 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:45.277424 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.278689 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.278695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:45.278896 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.278922 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 10:44:45.279012 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 10:44:45.279149 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 10:44:45.280109 8014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.273509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:35217 (local address 127.16.45.66:33381)
0806 10:44:45.273771 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:45.273779 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:45.274744 (+ 965us) server_negotiation.cc:407] Connection header received
0806 10:44:45.274976 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:45.274982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:45.275054 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:45.275140 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:44:45.275859 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.276562 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.278198 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.279049 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.279199 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.279268 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:45.279743 (+ 475us) server_negotiation.cc:299] Negotiation successful
0806 10:44:45.279870 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:44:45.280206 8030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.273526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:33381 (local address 127.16.45.67:35217)
0806 10:44:45.274641 (+ 1115us) negotiation.cc:107] Waiting for socket to connect
0806 10:44:45.274661 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:44:45.274848 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:44:45.275186 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:44:45.275192 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:44:45.275231 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:44:45.275611 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:45.275625 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.276713 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.276717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:45.278052 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:44:45.278065 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.279410 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.279415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:44:45.279586 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.279622 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 10:44:45.279715 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 10:44:45.279835 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":978,"mutex_wait_us":267,"thread_start_us":390,"threads_started":1}
I20260806 10:44:45.280750 7523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beb4009f36954dff972ac2bd6a5fc827" candidate_uuid: "bf8961e0426b4ce48057444649b1f612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "327b0d9951404af28e2c36263739298d" is_pre_election: true
I20260806 10:44:45.281327 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beb4009f36954dff972ac2bd6a5fc827" candidate_uuid: "bf8961e0426b4ce48057444649b1f612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4556271ef0df4923b9550a3ee709cfef" is_pre_election: true
I20260806 10:44:45.281527 7523 raft_consensus.cc:2454] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8961e0426b4ce48057444649b1f612 in term 0.
I20260806 10:44:45.281912 7731 raft_consensus.cc:2454] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf8961e0426b4ce48057444649b1f612 in term 0.
I20260806 10:44:45.282382 7835 leader_election.cc:302] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 327b0d9951404af28e2c36263739298d, bf8961e0426b4ce48057444649b1f612; no voters:
I20260806 10:44:45.282833 8027 raft_consensus.cc:2781] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:44:45.283010 8027 raft_consensus.cc:482] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:44:45.283129 8027 raft_consensus.cc:3037] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:45.285460 8027 raft_consensus.cc:504] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } } peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } }
I20260806 10:44:45.286103 8027 leader_election.cc:288] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [CANDIDATE]: Term 1 election: Requested vote from peers 327b0d9951404af28e2c36263739298d (127.16.45.65:42333), 4556271ef0df4923b9550a3ee709cfef (127.16.45.66:33381)
I20260806 10:44:45.286572 7523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beb4009f36954dff972ac2bd6a5fc827" candidate_uuid: "bf8961e0426b4ce48057444649b1f612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "327b0d9951404af28e2c36263739298d"
I20260806 10:44:45.286635 7731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beb4009f36954dff972ac2bd6a5fc827" candidate_uuid: "bf8961e0426b4ce48057444649b1f612" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4556271ef0df4923b9550a3ee709cfef"
I20260806 10:44:45.286806 7523 raft_consensus.cc:3037] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:45.286818 7731 raft_consensus.cc:3037] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:44:45.289960 7523 raft_consensus.cc:2454] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8961e0426b4ce48057444649b1f612 in term 1.
I20260806 10:44:45.289963 7731 raft_consensus.cc:2454] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf8961e0426b4ce48057444649b1f612 in term 1.
I20260806 10:44:45.290377 7835 leader_election.cc:302] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 327b0d9951404af28e2c36263739298d, bf8961e0426b4ce48057444649b1f612; no voters:
I20260806 10:44:45.290680 8027 raft_consensus.cc:2781] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 1 FOLLOWER]: Leader election won for term 1
W20260806 10:44:45.291092 7596 tablet.cc:2369] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:45.291152 8027 raft_consensus.cc:686] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 1 LEADER]: Becoming Leader. State: Replica: bf8961e0426b4ce48057444649b1f612, State: Running, Role: LEADER
I20260806 10:44:45.291638 8027 consensus_queue.cc:237] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } } peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } }
I20260806 10:44:45.296344 7305 catalog_manager.cc:5495] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf8961e0426b4ce48057444649b1f612 (127.16.45.67). New cstate: current_term: 1 leader_uuid: "bf8961e0426b4ce48057444649b1f612" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } health_report { overall_health: HEALTHY } } }
W20260806 10:44:45.318032 7804 tablet.cc:2369] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:45.342543 8015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.337136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35474 (local address 127.16.45.67:44151)
0806 10:44:45.337378 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:45.337384 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:45.337403 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:44:45.337625 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:45.337629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:45.337709 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:45.337848 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:44:45.338245 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.338993 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.340418 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.340813 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.340919 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.341441 (+ 522us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:44:45.341925 (+ 484us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:44:45.342062 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:45.342168 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 10:44:45.342259 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260806 10:44:45.346611 7992 tablet.cc:2369] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:44:45.350754 7731 raft_consensus.cc:1261] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef [term 1 FOLLOWER]: Refusing update from remote peer bf8961e0426b4ce48057444649b1f612: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:44:45.350759 7523 raft_consensus.cc:1261] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d [term 1 FOLLOWER]: Refusing update from remote peer bf8961e0426b4ce48057444649b1f612: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:44:45.351665 8027 consensus_queue.cc:1035] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:44:45.351938 8031 consensus_queue.cc:1035] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [LEADER]: Connected to new peer: Peer: permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:44:45.362629 8040 mvcc.cc:205] Tried to move back new op lower bound from 7315509597586317312 to 7315509597358297088. Current Snapshot: MvccSnapshot[applied={T|T < 7315509597586317312}]
I20260806 10:44:45.379346 7305 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:44:45.379606 7305 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:44:45.383404 7305 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Sending DeleteTablet for 3 replicas of tablet beb4009f36954dff972ac2bd6a5fc827
I20260806 10:44:45.384554 7490 tablet_service.cc:1514] Processing DeleteTablet for tablet beb4009f36954dff972ac2bd6a5fc827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:44:45 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:47538
I20260806 10:44:45.385381 8050 tablet_replica.cc:330] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d: stopping tablet replica
I20260806 10:44:45.385628 7703 tablet_service.cc:1514] Processing DeleteTablet for tablet beb4009f36954dff972ac2bd6a5fc827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:44:45 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:34400
I20260806 10:44:45.385802 8050 raft_consensus.cc:2229] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:44:45.386335 8050 raft_consensus.cc:2258] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:44:45.386854 7898 tablet_service.cc:1514] Processing DeleteTablet for tablet beb4009f36954dff972ac2bd6a5fc827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:44:45 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:35468
I20260806 10:44:45.387781 8052 tablet_replica.cc:330] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612: stopping tablet replica
I20260806 10:44:45.388047 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 7399
I20260806 10:44:45.388348 8052 raft_consensus.cc:2229] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:44:45.389060 8052 raft_consensus.cc:2258] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:44:45.391510 8052 ts_tablet_manager.cc:1905] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:45.397222 8051 tablet_replica.cc:330] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef: stopping tablet replica
I20260806 10:44:45.397506 8050 ts_tablet_manager.cc:1905] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:45.397655 8051 raft_consensus.cc:2229] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:44:45.398180 8051 raft_consensus.cc:2258] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:44:45.399632 8052 ts_tablet_manager.cc:1918] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:44:45.399876 8052 log.cc:1196] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/beb4009f36954dff972ac2bd6a5fc827
I20260806 10:44:45.400291 8051 ts_tablet_manager.cc:1905] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:44:45.400627 8052 ts_tablet_manager.cc:1939] T beb4009f36954dff972ac2bd6a5fc827 P bf8961e0426b4ce48057444649b1f612: Deleting consensus metadata
I20260806 10:44:45.402490 7283 catalog_manager.cc:4841] TS bf8961e0426b4ce48057444649b1f612 (127.16.45.67:44151): tablet beb4009f36954dff972ac2bd6a5fc827 (table test-table [id=d4295aed166241ebbe380f88a6aa87c8]) successfully deleted
I20260806 10:44:45.405614 8051 ts_tablet_manager.cc:1918] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:44:45.405757 8051 log.cc:1196] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/beb4009f36954dff972ac2bd6a5fc827
I20260806 10:44:45.406275 8051 ts_tablet_manager.cc:1939] T beb4009f36954dff972ac2bd6a5fc827 P 4556271ef0df4923b9550a3ee709cfef: Deleting consensus metadata
I20260806 10:44:45.406651 8050 ts_tablet_manager.cc:1918] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:44:45.406821 8050 log.cc:1196] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/beb4009f36954dff972ac2bd6a5fc827
I20260806 10:44:45.407322 8050 ts_tablet_manager.cc:1939] T beb4009f36954dff972ac2bd6a5fc827 P 327b0d9951404af28e2c36263739298d: Deleting consensus metadata
I20260806 10:44:45.408109 7285 catalog_manager.cc:4841] TS 4556271ef0df4923b9550a3ee709cfef (127.16.45.66:33381): tablet beb4009f36954dff972ac2bd6a5fc827 (table test-table [id=d4295aed166241ebbe380f88a6aa87c8]) successfully deleted
I20260806 10:44:45.409029 7286 catalog_manager.cc:4841] TS 327b0d9951404af28e2c36263739298d (127.16.45.65:42333): tablet beb4009f36954dff972ac2bd6a5fc827 (table test-table [id=d4295aed166241ebbe380f88a6aa87c8]) successfully deleted
Aug 06 10:44:45 dist-test-slave-fgb3 krb5kdc[7231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:44:45.427001 8010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.389175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47552 (local address 127.16.45.65:42333)
0806 10:44:45.389345 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:45.389351 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:45.409086 (+ 19735us) server_negotiation.cc:407] Connection header received
0806 10:44:45.409361 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:45.409367 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:45.409462 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:45.409525 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:45.411592 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.412696 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.414625 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.415267 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.415429 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.420820 (+ 5391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:45.420838 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:45.420859 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:45.420908 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:45.423952 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:45.424879 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:45.424887 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:45.424889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:45.425021 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:45.425434 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:45.425437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:45.425439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:45.425839 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:45.426062 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:45.426550 (+ 488us) server_negotiation.cc:299] Negotiation successful
0806 10:44:45.426716 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 10:44:45.427596 7584 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:45.517081 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 7399
I20260806 10:44:45.546191 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 7602
Aug 06 10:44:45 dist-test-slave-fgb3 krb5kdc[7231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:44:45.565317 8014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.547028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34416 (local address 127.16.45.66:33381)
0806 10:44:45.547264 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:45.547269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:45.547287 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:44:45.547500 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:45.547504 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:45.547571 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:45.547679 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:45.549409 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.550146 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.552086 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.552486 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.552582 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.558196 (+ 5614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:45.558219 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:45.558240 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:45.558296 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:45.561934 (+ 3638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:45.562841 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:45.562852 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:45.562855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:45.563026 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:45.563416 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:45.563422 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:45.563425 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:45.564017 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:45.564327 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:45.564713 (+ 386us) server_negotiation.cc:299] Negotiation successful
0806 10:44:45.564962 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260806 10:44:45.566073 7797 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:45.699556 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 7602
I20260806 10:44:45.720634 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 7811
Aug 06 10:44:45 dist-test-slave-fgb3 krb5kdc[7231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:44:45.737332 8015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:44:45.721412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35482 (local address 127.16.45.67:44151)
0806 10:44:45.721615 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 10:44:45.721621 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:44:45.721726 (+ 105us) server_negotiation.cc:407] Connection header received
0806 10:44:45.721917 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:44:45.721923 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:44:45.722000 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:44:45.722089 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:44:45.723519 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.724333 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.725708 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:44:45.726192 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:44:45.726306 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:44:45.730963 (+ 4657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:44:45.730977 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:44:45.730992 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:44:45.731037 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:44:45.734408 (+ 3371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:45.735152 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:45.735160 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:45.735162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:45.735327 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:44:45.735711 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:44:45.735717 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:44:45.735719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:44:45.736117 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:44:45.736431 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0806 10:44:45.736759 (+ 328us) server_negotiation.cc:299] Negotiation successful
0806 10:44:45.736993 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 10:44:45.738040 7985 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:45.863032 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 7811
I20260806 10:44:45.887821 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 7257
I20260806 10:44:45.888988 7354 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:44:45.999130 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 7257
I20260806 10:45:06.023882 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40843
--webserver_interface=127.16.45.126
--webserver_port=32777
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:40843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:45:06.365372 8061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:06.365692 8061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:06.365834 8061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:06.373168 8061 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 10:45:06.373281 8061 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 10:45:06.373349 8061 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 10:45:06.373432 8061 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:45:06.373510 8061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:06.373615 8061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:06.373673 8061 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:45:06.373749 8061 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:45:06.383848 8061 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:40843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=32777
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:06.385170 8061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:06.386554 8061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:06.411461 8070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:06.411506 8074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:06.411530 8071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:06.416396 8061 server_base.cc:1034] running on GCE node
I20260806 10:45:06.417445 8061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:06.419196 8061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:06.420466 8061 hybrid_clock.cc:648] HybridClock initialized: now 1786013106420392 us; error 43 us; skew 500 ppm
I20260806 10:45:06.420874 8061 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:06 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013106, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:06.427908 8061 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:45:06.429741 8061 webserver.cc:460] Webserver started at http://127.16.45.126:32777/ using document root <none> and password file <none>
I20260806 10:45:06.430655 8061 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:06.430785 8061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:06.437158 8061 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 10:45:06.440405 8083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:06.441872 8061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:45:06.442080 8061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "6cc1f5b2fa994fd3a370a11240927d2d"
format_stamp: "Formatted at 2026-08-06 10:44:43 on dist-test-slave-fgb3"
server_key: "2bcec39d4b61cc2dd648ce2cd22bea6d"
server_key_iv: "a730f6eade5581a1de9136927db4eb00"
server_key_version: "encryptionkey@0"
I20260806 10:45:06.443218 8061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:06.462358 8061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:06.466821 8061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:06.467114 8061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:06.486002 8061 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:40843
I20260806 10:45:06.486032 8151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:40843 every 8 connection(s)
I20260806 10:45:06.487560 8061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:45:06.494588 8153 sys_catalog.cc:263] Verifying existing consensus state
I20260806 10:45:06.495162 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 8061
I20260806 10:45:06.495990 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:42333
--local_ip_for_outbound_sockets=127.16.45.65
--tserver_master_addrs=127.16.45.126:40843
--webserver_port=44221
--webserver_interface=127.16.45.65
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:45:06.498003 8153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Bootstrap starting.
I20260806 10:45:06.517910 8153 log.cc:824] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:06.530934 8153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 10:45:06.531462 8153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Bootstrap complete.
I20260806 10:45:06.540870 8153 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } }
I20260806 10:45:06.541775 8153 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc1f5b2fa994fd3a370a11240927d2d, State: Initialized, Role: FOLLOWER
I20260806 10:45:06.542430 8153 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } }
I20260806 10:45:06.542675 8153 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:45:06.542793 8153 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:45:06.542948 8153 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 1 FOLLOWER]: Advancing to term 2
I20260806 10:45:06.546936 8153 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } }
I20260806 10:45:06.547523 8153 leader_election.cc:302] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cc1f5b2fa994fd3a370a11240927d2d; no voters:
I20260806 10:45:06.548166 8153 leader_election.cc:288] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 10:45:06.548336 8159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 2 FOLLOWER]: Leader election won for term 2
I20260806 10:45:06.550549 8153 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:45:06.554629 8159 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 2 LEADER]: Becoming Leader. State: Replica: 6cc1f5b2fa994fd3a370a11240927d2d, State: Running, Role: LEADER
I20260806 10:45:06.555415 8159 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } }
I20260806 10:45:06.558215 8160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } } }
I20260806 10:45:06.558655 8160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: This master's current role is: LEADER
I20260806 10:45:06.559213 8161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc1f5b2fa994fd3a370a11240927d2d. Latest consensus state: current_term: 2 leader_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } } }
I20260806 10:45:06.559489 8161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: This master's current role is: LEADER
I20260806 10:45:06.566097 8171 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:45:06.574548 8171 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:45:06.576117 8171 catalog_manager.cc:1259] Loaded cluster ID: 9d21909fb5934d7d9f0c16f5d1ab0285
I20260806 10:45:06.576325 8171 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:45:06.580590 8171 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:45:06.581372 8184 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 10:45:06.582422 8171 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Loaded TSK: 0
I20260806 10:45:06.612332 8171 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Generated new TSK 1
I20260806 10:45:06.612746 8171 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 10:45:06.849941 8155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:06.850237 8155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:06.850399 8155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:06.858130 8155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:06.858285 8155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:06.858501 8155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:45:06.869601 8155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:42333
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=44221
--tserver_master_addrs=127.16.45.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:06.871012 8155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:06.872349 8155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:06.887272 8193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:06.887523 8191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:06.887899 8197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:06.888427 8155 server_base.cc:1034] running on GCE node
I20260806 10:45:06.889086 8155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:06.890105 8155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:06.891319 8155 hybrid_clock.cc:648] HybridClock initialized: now 1786013106891257 us; error 56 us; skew 500 ppm
I20260806 10:45:06.891675 8155 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:06 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013106, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:06.894906 8155 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:45:06.896495 8155 webserver.cc:460] Webserver started at http://127.16.45.65:44221/ using document root <none> and password file <none>
I20260806 10:45:06.897189 8155 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:06.897323 8155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:06.903272 8155 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 10:45:06.906040 8205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:06.907563 8155 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 10:45:06.907729 8155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "327b0d9951404af28e2c36263739298d"
format_stamp: "Formatted at 2026-08-06 10:44:43 on dist-test-slave-fgb3"
server_key: "dafb22bfd080ab91613d6cc377f04cf3"
server_key_iv: "f372ee18bb8bdd98934a103832edf08e"
server_key_version: "encryptionkey@0"
I20260806 10:45:06.908704 8155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:06.921515 8155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:06.925403 8155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:06.925694 8155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:06.926666 8155 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:06.927979 8155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:06.928071 8155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:06.928179 8155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:06.928251 8155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:06.959795 8155 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:42333
I20260806 10:45:06.959879 8355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:42333 every 8 connection(s)
I20260806 10:45:06.961197 8155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:45:06.965123 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 8155
I20260806 10:45:06.965942 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:33381
--local_ip_for_outbound_sockets=127.16.45.66
--tserver_master_addrs=127.16.45.126:40843
--webserver_port=36011
--webserver_interface=127.16.45.66
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 10:45:06 dist-test-slave-fgb3 krb5kdc[7231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013106, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:45:06.985679 8361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:06.964170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:36089)
0806 10:45:06.965307 (+ 1137us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:06.965363 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:06.967650 (+ 2287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:06.969007 (+ 1357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:06.969018 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:06.969691 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:06.970423 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:06.970448 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:06.972043 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:06.972048 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:06.973797 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:06.973811 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:06.974823 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:06.974831 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:06.975089 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:06.975768 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:45:06.975795 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:06.978240 (+ 2445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:06.981435 (+ 3195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:06.981444 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:06.981460 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:06.981869 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:06.982292 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:06.982298 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:06.982302 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:06.982509 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:06.983248 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:06.983256 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:06.983573 (+ 317us) client_negotiation.cc:769] Sending connection context
0806 10:45:06.983802 (+ 229us) client_negotiation.cc:240] Negotiation successful
0806 10:45:06.984373 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":772,"thread_start_us":547,"threads_started":1}
I20260806 10:45:06.985679 8359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:06.963961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:36089 (local address 127.16.45.126:40843)
0806 10:45:06.964786 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:06.964803 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:06.965500 (+ 697us) server_negotiation.cc:407] Connection header received
0806 10:45:06.968189 (+ 2689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:06.968202 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:06.968523 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:06.968804 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:06.970630 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:06.971860 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:06.973926 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:06.974598 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:06.974723 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:06.978532 (+ 3809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:06.978539 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:06.978554 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:06.978597 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:06.981300 (+ 2703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:06.982009 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:06.982015 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:06.982020 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:06.982179 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:06.982625 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:06.982629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:06.982630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:06.983104 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:06.983296 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:06.984052 (+ 756us) server_negotiation.cc:299] Negotiation successful
0806 10:45:06.984437 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":481,"threads_started":1}
I20260806 10:45:06.988834 8356 heartbeater.cc:347] Connected to a master server at 127.16.45.126:40843
I20260806 10:45:06.989117 8356 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:06.989818 8356 heartbeater.cc:511] Master 127.16.45.126:40843 requested a full tablet report, sending...
I20260806 10:45:06.992189 8103 ts_manager.cc:194] Registered new tserver with Master: 327b0d9951404af28e2c36263739298d (127.16.45.65:42333)
I20260806 10:45:06.994398 8103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:36089
W20260806 10:45:07.302495 8362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:07.302786 8362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:07.302883 8362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:07.310456 8362 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:07.310578 8362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:07.310698 8362 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:45:07.322278 8362 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:33381
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=36011
--tserver_master_addrs=127.16.45.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:07.323582 8362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:07.324831 8362 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:07.337332 8368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:07.337388 8371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:07.337414 8369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:07.338446 8362 server_base.cc:1034] running on GCE node
I20260806 10:45:07.339036 8362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:07.339952 8362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:07.341148 8362 hybrid_clock.cc:648] HybridClock initialized: now 1786013107341098 us; error 47 us; skew 500 ppm
I20260806 10:45:07.341444 8362 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:07 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013107, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:07.344512 8362 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:45:07.345889 8362 webserver.cc:460] Webserver started at http://127.16.45.66:36011/ using document root <none> and password file <none>
I20260806 10:45:07.346606 8362 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:07.346738 8362 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:07.352152 8362 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 10:45:07.354866 8381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:07.356280 8362 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:45:07.356439 8362 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "4556271ef0df4923b9550a3ee709cfef"
format_stamp: "Formatted at 2026-08-06 10:44:44 on dist-test-slave-fgb3"
server_key: "638cc8f70f7e706486a5b402fadbcfca"
server_key_iv: "eeea66ec3f8639a82616a0574eb8616e"
server_key_version: "encryptionkey@0"
I20260806 10:45:07.357393 8362 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:07.384444 8362 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:07.388721 8362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:07.388998 8362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:07.390034 8362 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:07.391489 8362 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:07.391599 8362 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:07.391714 8362 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:07.391785 8362 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:07.423544 8362 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:33381
I20260806 10:45:07.423615 8543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:33381 every 8 connection(s)
I20260806 10:45:07.424997 8362 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:45:07.426944 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 8362
I20260806 10:45:07.427624 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:44151
--local_ip_for_outbound_sockets=127.16.45.67
--tserver_master_addrs=127.16.45.126:40843
--webserver_port=32857
--webserver_interface=127.16.45.67
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 10:45:07 dist-test-slave-fgb3 krb5kdc[7231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013107, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:45:07.446791 8359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.427516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:36275 (local address 127.16.45.126:40843)
0806 10:45:07.427735 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:07.427741 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:07.428987 (+ 1246us) server_negotiation.cc:407] Connection header received
0806 10:45:07.430893 (+ 1906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:07.430898 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:07.430984 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:07.431091 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:07.432688 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.433641 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.435825 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.436393 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.436489 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.441144 (+ 4655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:07.441149 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:07.441153 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:07.441189 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:07.443684 (+ 2495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:07.444534 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:07.444538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:07.444540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:07.444655 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:07.445077 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:07.445080 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:07.445082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:07.445344 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:07.445451 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:07.446279 (+ 828us) server_negotiation.cc:299] Negotiation successful
0806 10:45:07.446520 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 10:45:07.448282 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.428000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:36275)
0806 10:45:07.428789 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:07.428844 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:07.430614 (+ 1770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:07.431292 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:07.431308 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:07.431902 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:07.432487 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:07.432507 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.433854 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.433860 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:07.435657 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:07.435672 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.436845 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.436852 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:07.437143 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.437876 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:45:07.437916 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:07.440889 (+ 2973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:07.443838 (+ 2949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:07.443849 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:07.443866 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:07.444431 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:07.444748 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:07.444752 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:07.444755 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:07.444989 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:07.445485 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:07.445494 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:07.445917 (+ 423us) client_negotiation.cc:769] Sending connection context
0806 10:45:07.446214 (+ 297us) client_negotiation.cc:240] Negotiation successful
0806 10:45:07.446811 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":314,"threads_started":1}
I20260806 10:45:07.449752 8544 heartbeater.cc:347] Connected to a master server at 127.16.45.126:40843
I20260806 10:45:07.450071 8544 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:07.450992 8544 heartbeater.cc:511] Master 127.16.45.126:40843 requested a full tablet report, sending...
I20260806 10:45:07.452502 8103 ts_manager.cc:194] Registered new tserver with Master: 4556271ef0df4923b9550a3ee709cfef (127.16.45.66:33381)
I20260806 10:45:07.453344 8103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:36275
W20260806 10:45:07.767406 8549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:07.767675 8549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:07.767814 8549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:07.774842 8549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:07.774960 8549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:07.775122 8549 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:45:07.784586 8549 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:44151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=32857
--tserver_master_addrs=127.16.45.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:07.785808 8549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:07.787112 8549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:07.799860 8559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:07.799923 8562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:07.799897 8564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:07.800617 8549 server_base.cc:1034] running on GCE node
I20260806 10:45:07.801200 8549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:07.802089 8549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:07.803294 8549 hybrid_clock.cc:648] HybridClock initialized: now 1786013107803231 us; error 46 us; skew 500 ppm
I20260806 10:45:07.803591 8549 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:07 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013107, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:07.806520 8549 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:45:07.807927 8549 webserver.cc:460] Webserver started at http://127.16.45.67:32857/ using document root <none> and password file <none>
I20260806 10:45:07.808590 8549 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:07.808707 8549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:07.813743 8549 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:45:07.816318 8572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:07.817639 8549 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:45:07.817824 8549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "bf8961e0426b4ce48057444649b1f612"
format_stamp: "Formatted at 2026-08-06 10:44:45 on dist-test-slave-fgb3"
server_key: "6cdabe86a08ce70f3fe9ee6390fd54f1"
server_key_iv: "a2a6f1defc6f7dc68649154b213d5b78"
server_key_version: "encryptionkey@0"
I20260806 10:45:07.818862 8549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:07.838761 8549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:07.842865 8549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:07.843125 8549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:07.844125 8549 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:07.845463 8549 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:07.845557 8549 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:07.845683 8549 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:07.845749 8549 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:07.878840 8549 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:44151
I20260806 10:45:07.878916 8727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:44151 every 8 connection(s)
I20260806 10:45:07.880275 8549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:45:07.890568 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 8549
Aug 06 10:45:07 dist-test-slave-fgb3 krb5kdc[7231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013107, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:45:07.900642 8359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.882643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:43093 (local address 127.16.45.126:40843)
0806 10:45:07.882839 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:07.882846 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:07.884013 (+ 1167us) server_negotiation.cc:407] Connection header received
0806 10:45:07.885840 (+ 1827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:07.885845 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:07.885917 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:07.886008 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:07.887493 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.888207 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.890002 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.890659 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.890793 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.894871 (+ 4078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:07.894876 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:07.894887 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:07.894926 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:07.897538 (+ 2612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:07.898276 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:07.898281 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:07.898284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:07.898442 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:07.898902 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:07.898905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:07.898907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:07.899182 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:07.899316 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:07.900028 (+ 712us) server_negotiation.cc:299] Negotiation successful
0806 10:45:07.900254 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 10:45:07.901672 8730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.883147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:43093)
0806 10:45:07.883834 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:07.883888 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:07.885596 (+ 1708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:07.886200 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:07.886208 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:07.886753 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:07.887333 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:07.887351 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.888416 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.888420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:07.889838 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:07.889850 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.890889 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.890895 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:07.891106 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.891807 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:45:07.891849 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:07.894638 (+ 2789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:07.897681 (+ 3043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:07.897691 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:07.897710 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:07.898159 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:07.898549 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:07.898554 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:07.898558 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:07.898751 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:07.899309 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:07.899317 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:07.899678 (+ 361us) client_negotiation.cc:769] Sending connection context
0806 10:45:07.899929 (+ 251us) client_negotiation.cc:240] Negotiation successful
0806 10:45:07.900494 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":278,"threads_started":1}
I20260806 10:45:07.903368 8728 heartbeater.cc:347] Connected to a master server at 127.16.45.126:40843
I20260806 10:45:07.903673 8728 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:07.904618 8728 heartbeater.cc:511] Master 127.16.45.126:40843 requested a full tablet report, sending...
I20260806 10:45:07.906288 8103 ts_manager.cc:194] Registered new tserver with Master: bf8961e0426b4ce48057444649b1f612 (127.16.45.67:44151)
I20260806 10:45:07.906684 8733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.891694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40018 (local address 127.16.45.126:40843)
0806 10:45:07.892554 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:07.892558 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:07.892572 (+ 14us) server_negotiation.cc:407] Connection header received
0806 10:45:07.892612 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:07.892615 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:07.892669 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:07.892754 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:07.894783 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.895776 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.897354 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.897821 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.897930 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.900681 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:07.900685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:07.900688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:07.900720 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:07.903743 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:07.904574 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:07.904578 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:07.904580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:07.904690 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:07.905080 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:07.905085 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:07.905088 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:07.905438 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:07.905636 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:07.905979 (+ 343us) server_negotiation.cc:299] Negotiation successful
0806 10:45:07.906145 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":761,"thread_start_us":630,"threads_started":1}
I20260806 10:45:07.907433 8103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:43093
I20260806 10:45:07.909281 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:45:07.916597 8733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.910253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40030 (local address 127.16.45.126:40843)
0806 10:45:07.910469 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:07.910476 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:07.910815 (+ 339us) server_negotiation.cc:407] Connection header received
0806 10:45:07.911001 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:07.911005 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:07.911137 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:07.911276 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:45:07.911636 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.912367 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.913847 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.914270 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.914414 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.914894 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:45:07.915928 (+ 1034us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 10:45:07.916338 (+ 410us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40030: token expired
Metrics: {"server-negotiator.queue_time_us":85}
W20260806 10:45:07.916711 8733 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40030: token expired
W20260806 10:45:07.917248 7996 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.16.45.126:40843)
I20260806 10:45:07.929473 8733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.917706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40042 (local address 127.16.45.126:40843)
0806 10:45:07.917854 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:07.917858 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:07.917939 (+ 81us) server_negotiation.cc:407] Connection header received
0806 10:45:07.918075 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:07.918078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:07.918132 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:07.918202 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:07.919591 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.920287 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.921619 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.922009 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.922102 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.924744 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:07.924749 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:07.924752 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:07.924785 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:07.927224 (+ 2439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:07.927826 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:07.927830 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:07.927832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:07.927951 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:07.928247 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:07.928250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:07.928252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:07.928580 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:07.928758 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:07.929012 (+ 254us) server_negotiation.cc:299] Negotiation successful
0806 10:45:07.929179 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 10:45:07.932945 8103 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40042:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:45:07.940353 8103 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:45:07.980724 8740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.951711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:44151 (local address 127.0.0.1:52844)
0806 10:45:07.967613 (+ 15902us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:07.967652 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:07.967818 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:07.971712 (+ 3894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:07.971721 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:07.971758 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:07.972517 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:07.972532 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.975391 (+ 2859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.975396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:07.977857 (+ 2461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:07.977879 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.979803 (+ 1924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.979809 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:07.980019 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.980061 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 10:45:07.980174 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 10:45:07.980349 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15668,"thread_start_us":15511,"threads_started":1}
I20260806 10:45:07.980985 8742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.951986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52844 (local address 127.16.45.67:44151)
0806 10:45:07.971022 (+ 19036us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:07.971030 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:07.971069 (+ 39us) server_negotiation.cc:407] Connection header received
0806 10:45:07.971174 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:07.971183 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:07.971450 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:07.971663 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:07.972778 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.975220 (+ 2442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.978179 (+ 2959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.979600 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.979711 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.979950 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:07.980526 (+ 576us) server_negotiation.cc:299] Negotiation successful
0806 10:45:07.980688 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18822,"thread_start_us":18640,"threads_started":1}
I20260806 10:45:07.981771 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.953688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60328 (local address 127.16.45.66:33381)
0806 10:45:07.974573 (+ 20885us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:07.974579 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:07.975104 (+ 525us) server_negotiation.cc:407] Connection header received
0806 10:45:07.975276 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:07.975285 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:07.975493 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:07.975643 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:07.976217 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.977195 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.979034 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.980282 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.980434 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.980603 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:07.981282 (+ 679us) server_negotiation.cc:299] Negotiation successful
0806 10:45:07.981457 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20759,"thread_start_us":20876,"threads_started":1}
I20260806 10:45:07.982383 8747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.952383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41090 (local address 127.16.45.65:42333)
0806 10:45:07.968407 (+ 16024us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:07.968417 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:07.974009 (+ 5592us) server_negotiation.cc:407] Connection header received
0806 10:45:07.974175 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:07.974184 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:07.974474 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:07.974668 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:07.975309 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.976835 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.979405 (+ 2570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.980775 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.980920 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.981123 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:07.981883 (+ 760us) server_negotiation.cc:299] Negotiation successful
0806 10:45:07.982044 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15835,"thread_start_us":15882,"threads_started":1}
I20260806 10:45:07.982393 8748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.953532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:33381 (local address 127.0.0.1:60328)
0806 10:45:07.974984 (+ 21452us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:07.975001 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:07.975126 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:07.975663 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:07.975667 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:07.975690 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:07.976066 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:07.976076 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.977323 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.977328 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:07.978878 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:07.978905 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.980762 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.980768 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:07.980926 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.980956 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 10:45:07.981035 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 10:45:07.982012 (+ 977us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21352,"mutex_wait_us":22,"thread_start_us":21669,"threads_started":1}
I20260806 10:45:07.982898 8741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:07.951880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:42333 (local address 127.0.0.1:41090)
0806 10:45:07.973889 (+ 22009us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:07.973910 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:07.974036 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:07.974687 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:07.974692 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:07.974716 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:07.975111 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:07.975124 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.977024 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.977030 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:07.979238 (+ 2208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:07.979254 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:07.981363 (+ 2109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:07.981374 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:07.981537 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:07.981569 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 10:45:07.982389 (+ 820us) client_negotiation.cc:240] Negotiation successful
0806 10:45:07.982523 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21847,"mutex_wait_us":4,"thread_start_us":22255,"threads_started":1}
I20260806 10:45:07.985190 8635 tablet_service.cc:1467] Processing CreateTablet for tablet 87040aff18e04406b3feacf60fc66f1e (DEFAULT_TABLE table=test-table [id=149f9b6fac7d422aab51e16c9eb9b0db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:45:07.985952 8452 tablet_service.cc:1467] Processing CreateTablet for tablet 87040aff18e04406b3feacf60fc66f1e (DEFAULT_TABLE table=test-table [id=149f9b6fac7d422aab51e16c9eb9b0db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:45:07.986155 8264 tablet_service.cc:1467] Processing CreateTablet for tablet 87040aff18e04406b3feacf60fc66f1e (DEFAULT_TABLE table=test-table [id=149f9b6fac7d422aab51e16c9eb9b0db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:45:07.986756 8635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87040aff18e04406b3feacf60fc66f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:07.987043 8452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87040aff18e04406b3feacf60fc66f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:07.987500 8264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87040aff18e04406b3feacf60fc66f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:07.997574 8356 heartbeater.cc:503] Master 127.16.45.126:40843 was elected leader, sending a full tablet report...
I20260806 10:45:07.998679 8750 tablet_bootstrap.cc:492] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef: Bootstrap starting.
I20260806 10:45:08.001824 8750 tablet_bootstrap.cc:654] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:08.002540 8751 tablet_bootstrap.cc:492] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d: Bootstrap starting.
I20260806 10:45:08.003237 8750 log.cc:824] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:08.004673 8753 tablet_bootstrap.cc:492] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612: Bootstrap starting.
I20260806 10:45:08.006107 8751 tablet_bootstrap.cc:654] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:08.006191 8750 tablet_bootstrap.cc:492] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef: No bootstrap required, opened a new log
I20260806 10:45:08.006479 8750 ts_tablet_manager.cc:1397] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 10:45:08.007412 8751 log.cc:824] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:08.008215 8753 tablet_bootstrap.cc:654] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:08.009320 8753 log.cc:824] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:08.010854 8751 tablet_bootstrap.cc:492] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d: No bootstrap required, opened a new log
I20260806 10:45:08.011154 8751 ts_tablet_manager.cc:1397] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260806 10:45:08.012360 8753 tablet_bootstrap.cc:492] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612: No bootstrap required, opened a new log
I20260806 10:45:08.012625 8753 ts_tablet_manager.cc:1397] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260806 10:45:08.014851 8750 raft_consensus.cc:348] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } } peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } }
I20260806 10:45:08.015195 8750 raft_consensus.cc:374] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:08.015291 8750 raft_consensus.cc:729] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4556271ef0df4923b9550a3ee709cfef, State: Initialized, Role: FOLLOWER
I20260806 10:45:08.015859 8750 consensus_queue.cc:260] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } } peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } }
I20260806 10:45:08.016957 8544 heartbeater.cc:503] Master 127.16.45.126:40843 was elected leader, sending a full tablet report...
I20260806 10:45:08.017630 8750 ts_tablet_manager.cc:1428] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20260806 10:45:08.021646 8751 raft_consensus.cc:348] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } } peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } }
I20260806 10:45:08.022130 8751 raft_consensus.cc:374] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:08.022233 8751 raft_consensus.cc:729] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 327b0d9951404af28e2c36263739298d, State: Initialized, Role: FOLLOWER
I20260806 10:45:08.022891 8751 consensus_queue.cc:260] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } } peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } }
I20260806 10:45:08.022876 8753 raft_consensus.cc:348] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } } peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } }
I20260806 10:45:08.023288 8753 raft_consensus.cc:374] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:08.023409 8753 raft_consensus.cc:729] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8961e0426b4ce48057444649b1f612, State: Initialized, Role: FOLLOWER
I20260806 10:45:08.023985 8753 consensus_queue.cc:260] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } } peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } }
I20260806 10:45:08.024892 8751 ts_tablet_manager.cc:1428] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260806 10:45:08.025082 8728 heartbeater.cc:503] Master 127.16.45.126:40843 was elected leader, sending a full tablet report...
I20260806 10:45:08.026737 8753 ts_tablet_manager.cc:1428] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
W20260806 10:45:08.131965 8729 tablet.cc:2369] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:45:08.176923 8545 tablet.cc:2369] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:45:08.213518 8358 tablet.cc:2369] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:45:08.246785 8759 raft_consensus.cc:482] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:45:08.247102 8759 raft_consensus.cc:504] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } } peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } }
I20260806 10:45:08.248827 8759 leader_election.cc:288] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf8961e0426b4ce48057444649b1f612 (127.16.45.67:44151), 327b0d9951404af28e2c36263739298d (127.16.45.65:42333)
I20260806 10:45:08.255599 8747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:08.249254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:55555 (local address 127.16.45.65:42333)
0806 10:45:08.249469 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:08.249475 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:08.250174 (+ 699us) server_negotiation.cc:407] Connection header received
0806 10:45:08.250455 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:08.250460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:08.250530 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:08.250616 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:08.251169 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.251977 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.253829 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.254676 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.254837 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:08.254916 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:08.255218 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 10:45:08.255351 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 10:45:08.255666 8742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:08.249391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:34981 (local address 127.16.45.67:44151)
0806 10:45:08.249571 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:08.249575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:08.250545 (+ 970us) server_negotiation.cc:407] Connection header received
0806 10:45:08.250727 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:08.250731 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:08.250793 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:08.250869 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:08.251445 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.252189 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.253948 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.254769 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.254925 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:08.254998 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:08.255281 (+ 283us) server_negotiation.cc:299] Negotiation successful
0806 10:45:08.255420 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 10:45:08.255775 8763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:08.249266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:42333 (local address 127.16.45.66:55555)
0806 10:45:08.250038 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:08.250061 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:08.250249 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:08.250635 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:08.250640 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:08.250665 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:08.250963 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:08.250972 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.252115 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.252121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:08.253675 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:08.253687 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.254915 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.254922 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:08.255068 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:08.255093 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 10:45:08.255179 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 10:45:08.255329 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"mutex_wait_us":36,"thread_start_us":449,"threads_started":1}
I20260806 10:45:08.255829 8764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:08.249293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:44151 (local address 127.16.45.66:34981)
0806 10:45:08.250438 (+ 1145us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:08.250453 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:08.250584 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:08.250920 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:08.250925 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:08.250955 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:08.251294 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:08.251302 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.252316 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.252320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:08.253787 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:08.253799 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.254990 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.254996 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:08.255139 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:08.255161 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 10:45:08.255238 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 10:45:08.255363 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1044,"mutex_wait_us":16,"thread_start_us":810,"threads_started":1}
I20260806 10:45:08.256855 8663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87040aff18e04406b3feacf60fc66f1e" candidate_uuid: "4556271ef0df4923b9550a3ee709cfef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8961e0426b4ce48057444649b1f612" is_pre_election: true
I20260806 10:45:08.256856 8292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87040aff18e04406b3feacf60fc66f1e" candidate_uuid: "4556271ef0df4923b9550a3ee709cfef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "327b0d9951404af28e2c36263739298d" is_pre_election: true
I20260806 10:45:08.257383 8292 raft_consensus.cc:2454] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4556271ef0df4923b9550a3ee709cfef in term 0.
I20260806 10:45:08.257406 8663 raft_consensus.cc:2454] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4556271ef0df4923b9550a3ee709cfef in term 0.
I20260806 10:45:08.258061 8391 leader_election.cc:302] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 327b0d9951404af28e2c36263739298d, 4556271ef0df4923b9550a3ee709cfef; no voters:
I20260806 10:45:08.258466 8759 raft_consensus.cc:2781] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:45:08.258610 8759 raft_consensus.cc:482] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:45:08.258719 8759 raft_consensus.cc:3037] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:08.261005 8759 raft_consensus.cc:504] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } } peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } }
I20260806 10:45:08.261590 8759 leader_election.cc:288] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [CANDIDATE]: Term 1 election: Requested vote from peers bf8961e0426b4ce48057444649b1f612 (127.16.45.67:44151), 327b0d9951404af28e2c36263739298d (127.16.45.65:42333)
I20260806 10:45:08.262099 8663 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87040aff18e04406b3feacf60fc66f1e" candidate_uuid: "4556271ef0df4923b9550a3ee709cfef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8961e0426b4ce48057444649b1f612"
I20260806 10:45:08.262147 8292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87040aff18e04406b3feacf60fc66f1e" candidate_uuid: "4556271ef0df4923b9550a3ee709cfef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "327b0d9951404af28e2c36263739298d"
I20260806 10:45:08.262338 8663 raft_consensus.cc:3037] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:08.262365 8292 raft_consensus.cc:3037] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:08.264537 8663 raft_consensus.cc:2454] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4556271ef0df4923b9550a3ee709cfef in term 1.
I20260806 10:45:08.264544 8292 raft_consensus.cc:2454] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4556271ef0df4923b9550a3ee709cfef in term 1.
I20260806 10:45:08.264940 8391 leader_election.cc:302] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 327b0d9951404af28e2c36263739298d, 4556271ef0df4923b9550a3ee709cfef; no voters:
I20260806 10:45:08.265285 8759 raft_consensus.cc:2781] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:45:08.265713 8759 raft_consensus.cc:686] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 1 LEADER]: Becoming Leader. State: Replica: 4556271ef0df4923b9550a3ee709cfef, State: Running, Role: LEADER
I20260806 10:45:08.266184 8759 consensus_queue.cc:237] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } } peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } }
I20260806 10:45:08.271121 8102 catalog_manager.cc:5495] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef reported cstate change: term changed from 0 to 1, leader changed from <none> to 4556271ef0df4923b9550a3ee709cfef (127.16.45.66). New cstate: current_term: 1 leader_uuid: "4556271ef0df4923b9550a3ee709cfef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4556271ef0df4923b9550a3ee709cfef" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33381 } health_report { overall_health: HEALTHY } } }
I20260806 10:45:08.327844 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:08.322492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60344 (local address 127.16.45.66:33381)
0806 10:45:08.322716 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:08.322721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:08.322790 (+ 69us) server_negotiation.cc:407] Connection header received
0806 10:45:08.323039 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:08.323046 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:08.323140 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:08.323271 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:45:08.323649 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.324391 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.325789 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.326195 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.326306 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:08.326820 (+ 514us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:45:08.327333 (+ 513us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:45:08.327443 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:08.327551 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 10:45:08.327624 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 10:45:08.336838 8663 raft_consensus.cc:1261] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612 [term 1 FOLLOWER]: Refusing update from remote peer 4556271ef0df4923b9550a3ee709cfef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:45:08.336840 8292 raft_consensus.cc:1261] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d [term 1 FOLLOWER]: Refusing update from remote peer 4556271ef0df4923b9550a3ee709cfef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:45:08.337925 8765 consensus_queue.cc:1035] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [LEADER]: Connected to new peer: Peer: permanent_uuid: "327b0d9951404af28e2c36263739298d" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 42333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:45:08.338295 8759 consensus_queue.cc:1035] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8961e0426b4ce48057444649b1f612" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:45:08.349285 8768 mvcc.cc:205] Tried to move back new op lower bound from 7315509691736137728 to 7315509691462066176. Current Snapshot: MvccSnapshot[applied={T|T < 7315509691736137728}]
I20260806 10:45:08.349900 8770 mvcc.cc:205] Tried to move back new op lower bound from 7315509691736137728 to 7315509691462066176. Current Snapshot: MvccSnapshot[applied={T|T < 7315509691736137728}]
I20260806 10:45:08.367523 8103 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:45:08.367846 8103 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:45:08.371490 8103 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Sending DeleteTablet for 3 replicas of tablet 87040aff18e04406b3feacf60fc66f1e
I20260806 10:45:08.372668 8635 tablet_service.cc:1514] Processing DeleteTablet for tablet 87040aff18e04406b3feacf60fc66f1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:45:08 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:52844
I20260806 10:45:08.372953 8264 tablet_service.cc:1514] Processing DeleteTablet for tablet 87040aff18e04406b3feacf60fc66f1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:45:08 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:41090
I20260806 10:45:08.373360 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 8155
I20260806 10:45:08.373453 8452 tablet_service.cc:1514] Processing DeleteTablet for tablet 87040aff18e04406b3feacf60fc66f1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:45:08 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:60328
I20260806 10:45:08.373895 8784 tablet_replica.cc:330] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d: stopping tablet replica
I20260806 10:45:08.374390 8784 raft_consensus.cc:2229] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:45:08.374926 8784 raft_consensus.cc:2258] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:45:08.377177 8784 ts_tablet_manager.cc:1905] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:45:08.385166 8784 ts_tablet_manager.cc:1918] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:45:08.385422 8784 log.cc:1196] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/87040aff18e04406b3feacf60fc66f1e
I20260806 10:45:08.386020 8784 ts_tablet_manager.cc:1939] T 87040aff18e04406b3feacf60fc66f1e P 327b0d9951404af28e2c36263739298d: Deleting consensus metadata
I20260806 10:45:08.388281 8088 catalog_manager.cc:4841] TS 327b0d9951404af28e2c36263739298d (127.16.45.65:42333): tablet 87040aff18e04406b3feacf60fc66f1e (table test-table [id=149f9b6fac7d422aab51e16c9eb9b0db]) successfully deleted
I20260806 10:45:08.389420 8783 tablet_replica.cc:330] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612: stopping tablet replica
I20260806 10:45:08.389497 8785 tablet_replica.cc:330] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef: stopping tablet replica
I20260806 10:45:08.389976 8783 raft_consensus.cc:2229] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:45:08.389984 8785 raft_consensus.cc:2229] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:45:08.390589 8783 raft_consensus.cc:2258] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:45:08.390646 8785 raft_consensus.cc:2258] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:45:08.392896 8783 ts_tablet_manager.cc:1905] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:45:08.392903 8785 ts_tablet_manager.cc:1905] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:45:08.394601 8747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:08.375056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41098 (local address 127.16.45.65:42333)
0806 10:45:08.375399 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:08.375406 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:08.375427 (+ 21us) server_negotiation.cc:407] Connection header received
0806 10:45:08.375488 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:08.375493 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:08.375593 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:08.375725 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:08.377929 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.379407 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.381337 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.382019 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.382146 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:08.386193 (+ 4047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:08.386210 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:08.386229 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:08.386294 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:08.390286 (+ 3992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:08.391229 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:08.391251 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:08.391254 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:08.391419 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:08.391886 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:08.391891 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:08.391894 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:08.392374 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:08.392667 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:08.393955 (+ 1288us) server_negotiation.cc:299] Negotiation successful
0806 10:45:08.394184 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190}
I20260806 10:45:08.395749 8345 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:08.400758 8783 ts_tablet_manager.cc:1918] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:45:08.400930 8783 log.cc:1196] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/87040aff18e04406b3feacf60fc66f1e
I20260806 10:45:08.401469 8783 ts_tablet_manager.cc:1939] T 87040aff18e04406b3feacf60fc66f1e P bf8961e0426b4ce48057444649b1f612: Deleting consensus metadata
I20260806 10:45:08.403486 8085 catalog_manager.cc:4841] TS bf8961e0426b4ce48057444649b1f612 (127.16.45.67:44151): tablet 87040aff18e04406b3feacf60fc66f1e (table test-table [id=149f9b6fac7d422aab51e16c9eb9b0db]) successfully deleted
I20260806 10:45:08.404409 8785 ts_tablet_manager.cc:1918] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:45:08.404597 8785 log.cc:1196] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/87040aff18e04406b3feacf60fc66f1e
I20260806 10:45:08.405203 8785 ts_tablet_manager.cc:1939] T 87040aff18e04406b3feacf60fc66f1e P 4556271ef0df4923b9550a3ee709cfef: Deleting consensus metadata
I20260806 10:45:08.407099 8086 catalog_manager.cc:4841] TS 4556271ef0df4923b9550a3ee709cfef (127.16.45.66:33381): tablet 87040aff18e04406b3feacf60fc66f1e (table test-table [id=149f9b6fac7d422aab51e16c9eb9b0db]) successfully deleted
I20260806 10:45:08.514410 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 8155
I20260806 10:45:08.543038 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 8362
I20260806 10:45:08.560155 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:08.543784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60358 (local address 127.16.45.66:33381)
0806 10:45:08.544004 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:08.544010 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:08.544032 (+ 22us) server_negotiation.cc:407] Connection header received
0806 10:45:08.544130 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:08.544135 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:08.544221 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:08.544330 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:08.545846 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.547293 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.548961 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.549610 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.549743 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:08.552902 (+ 3159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:08.552919 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:08.552940 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:08.552990 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:08.556948 (+ 3958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:08.557764 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:08.557778 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:08.557782 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:08.557962 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:08.558401 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:08.558406 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:08.558409 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:08.558843 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:08.559198 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:08.559512 (+ 314us) server_negotiation.cc:299] Negotiation successful
0806 10:45:08.559744 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 10:45:08.561004 8536 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:08.675987 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 8362
I20260806 10:45:08.700702 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 8549
I20260806 10:45:08.714512 8742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:08.701501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52854 (local address 127.16.45.67:44151)
0806 10:45:08.701677 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:08.701681 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:08.701701 (+ 20us) server_negotiation.cc:407] Connection header received
0806 10:45:08.701886 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:08.701891 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:08.701965 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:08.702072 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:08.703570 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.704266 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.705555 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:08.705935 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:08.706024 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:08.708708 (+ 2684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:08.708729 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:08.708744 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:08.708782 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:08.711635 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:08.712400 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:08.712408 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:08.712410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:08.712597 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:08.712962 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:08.712966 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:08.712968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:08.713361 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:08.713601 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:08.713979 (+ 378us) server_negotiation.cc:299] Negotiation successful
0806 10:45:08.714165 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 10:45:08.715176 8721 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:08.803530 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 8549
I20260806 10:45:08.821664 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 8061
I20260806 10:45:08.822777 8145 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:08.938436 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 8061
I20260806 10:45:28.963935 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40843
--webserver_interface=127.16.45.126
--webserver_port=32777
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:40843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:45:29.298032 8790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:29.298367 8790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:29.298513 8790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:29.305688 8790 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 10:45:29.305809 8790 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 10:45:29.305874 8790 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 10:45:29.305953 8790 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:45:29.306030 8790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:29.306126 8790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:29.306186 8790 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:45:29.306262 8790 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:45:29.318570 8790 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:40843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=32777
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:29.319975 8790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:29.321272 8790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:29.332698 8803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:29.332799 8798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:29.332831 8799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:29.333259 8790 server_base.cc:1034] running on GCE node
I20260806 10:45:29.334190 8790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:29.335527 8790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:29.336750 8790 hybrid_clock.cc:648] HybridClock initialized: now 1786013129336685 us; error 32 us; skew 500 ppm
I20260806 10:45:29.337085 8790 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:29 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013129, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:29.345386 8790 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:45:29.347072 8790 webserver.cc:460] Webserver started at http://127.16.45.126:32777/ using document root <none> and password file <none>
I20260806 10:45:29.347801 8790 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:29.347916 8790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:29.353440 8790 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 10:45:29.356246 8810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:29.357618 8790 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:45:29.357805 8790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "6cc1f5b2fa994fd3a370a11240927d2d"
format_stamp: "Formatted at 2026-08-06 10:44:43 on dist-test-slave-fgb3"
server_key: "2bcec39d4b61cc2dd648ce2cd22bea6d"
server_key_iv: "a730f6eade5581a1de9136927db4eb00"
server_key_version: "encryptionkey@0"
I20260806 10:45:29.358824 8790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:29.369972 8790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:29.374013 8790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:29.374266 8790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:29.392864 8790 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:40843
I20260806 10:45:29.392917 8878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:40843 every 8 connection(s)
I20260806 10:45:29.394517 8790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:45:29.401394 8879 sys_catalog.cc:263] Verifying existing consensus state
I20260806 10:45:29.403314 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 8790
I20260806 10:45:29.404125 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:42333
--local_ip_for_outbound_sockets=127.16.45.65
--tserver_master_addrs=127.16.45.126:40843
--webserver_port=44221
--webserver_interface=127.16.45.65
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:45:29.404717 8879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Bootstrap starting.
I20260806 10:45:29.424898 8879 log.cc:824] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:29.441370 8879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 10:45:29.441900 8879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Bootstrap complete.
I20260806 10:45:29.451002 8879 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } }
I20260806 10:45:29.451915 8879 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc1f5b2fa994fd3a370a11240927d2d, State: Initialized, Role: FOLLOWER
I20260806 10:45:29.452550 8879 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } }
I20260806 10:45:29.452775 8879 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:45:29.452889 8879 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:45:29.453049 8879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 2 FOLLOWER]: Advancing to term 3
I20260806 10:45:29.456890 8879 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } }
I20260806 10:45:29.457369 8879 leader_election.cc:302] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cc1f5b2fa994fd3a370a11240927d2d; no voters:
I20260806 10:45:29.458037 8879 leader_election.cc:288] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 10:45:29.458187 8885 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 3 FOLLOWER]: Leader election won for term 3
I20260806 10:45:29.459362 8885 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [term 3 LEADER]: Becoming Leader. State: Replica: 6cc1f5b2fa994fd3a370a11240927d2d, State: Running, Role: LEADER
I20260806 10:45:29.459899 8885 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } }
I20260806 10:45:29.460269 8879 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:45:29.462512 8887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc1f5b2fa994fd3a370a11240927d2d. Latest consensus state: current_term: 3 leader_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } } }
I20260806 10:45:29.462898 8887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: This master's current role is: LEADER
I20260806 10:45:29.463493 8886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc1f5b2fa994fd3a370a11240927d2d" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40843 } } }
I20260806 10:45:29.463794 8886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d [sys.catalog]: This master's current role is: LEADER
I20260806 10:45:29.465833 8890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:45:29.474766 8890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:45:29.476599 8890 catalog_manager.cc:1259] Loaded cluster ID: 9d21909fb5934d7d9f0c16f5d1ab0285
I20260806 10:45:29.476716 8890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:45:29.480970 8890 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:45:29.482728 8890 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Loaded TSK: 0
I20260806 10:45:29.482892 8890 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6cc1f5b2fa994fd3a370a11240927d2d: Loaded TSK: 1
F20260806 10:45:29.484059 8890 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f0b053509ad google::LogMessage::Fail() at ??:0
@ 0x7f0b0535388a google::LogMessage::SendToLog() at ??:0
@ 0x7f0b053504de google::LogMessage::Flush() at ??:0
@ 0x7f0b05351a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f0b090b47d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f0b090a373e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f0b1ad7f1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f0b1ad7e783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f0b1ae0a2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f0b1ae0a0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f0b1ae545e9 std::function<>::operator()() at ??:0
@ 0x7f0b1ad82cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f0b1ad80c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f0b1ae08610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f0b1ae08439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f0b07f9c345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f0b07f9f91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f0b07f9f799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f0b07f7aeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f0b0b2546db start_thread at ??:0
@ 0x7f0b041ea61f clone at ??:0
W20260806 10:45:29.817927 8883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:29.818243 8883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:29.818387 8883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:29.825748 8883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:29.825873 8883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:29.825989 8883 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:45:29.836107 8883 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:42333
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=44221
--tserver_master_addrs=127.16.45.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:29.837387 8883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:29.838760 8883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:29.851804 8940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:29.851843 8945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:29.851898 8943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:29.852933 8883 server_base.cc:1034] running on GCE node
I20260806 10:45:29.853515 8883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:29.854454 8883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:29.855691 8883 hybrid_clock.cc:648] HybridClock initialized: now 1786013129855632 us; error 44 us; skew 500 ppm
I20260806 10:45:29.856076 8883 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:29 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013129, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:29.859369 8883 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:45:29.860926 8883 webserver.cc:460] Webserver started at http://127.16.45.65:44221/ using document root <none> and password file <none>
I20260806 10:45:29.861614 8883 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:29.861735 8883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:29.867113 8883 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 10:45:29.869829 8955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:29.871245 8883 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 10:45:29.871443 8883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "327b0d9951404af28e2c36263739298d"
format_stamp: "Formatted at 2026-08-06 10:44:43 on dist-test-slave-fgb3"
server_key: "dafb22bfd080ab91613d6cc377f04cf3"
server_key_iv: "f372ee18bb8bdd98934a103832edf08e"
server_key_version: "encryptionkey@0"
I20260806 10:45:29.872447 8883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:29.891595 8883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:29.895939 8883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:29.896234 8883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:29.897301 8883 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:29.898746 8883 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:29.898849 8883 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:29.898974 8883 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:29.899047 8883 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:29.931910 8883 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:42333
I20260806 10:45:29.931979 9118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:42333 every 8 connection(s)
I20260806 10:45:29.933317 8883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:45:29.938012 9121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:29.936170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:51407)
0806 10:45:29.936894 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:29.937129 (+ 235us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":279,"threads_started":1}
W20260806 10:45:29.938695 9119 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:40843 (0 consecutive failures): Network error: Failed to ping master at 127.16.45.126:40843: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
I20260806 10:45:29.939435 9121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:29.939139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:51315)
0806 10:45:29.939263 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:29.939338 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 10:45:29.940228 9121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:29.939923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:43341)
0806 10:45:29.940052 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:29.940128 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 10:45:29.940459 9119 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 10:45:29.943894 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 8883
I20260806 10:45:29.944716 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:33381
--local_ip_for_outbound_sockets=127.16.45.66
--tserver_master_addrs=127.16.45.126:40843
--webserver_port=36011
--webserver_interface=127.16.45.66
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:45:30.285241 9122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:30.285535 9122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:30.285631 9122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:30.292907 9122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:30.293016 9122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:30.293134 9122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:45:30.302850 9122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:33381
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=36011
--tserver_master_addrs=127.16.45.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:30.304359 9122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:30.305651 9122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:30.318497 9127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:30.318521 9128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:30.318461 9132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:30.319267 9122 server_base.cc:1034] running on GCE node
I20260806 10:45:30.319926 9122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:30.320873 9122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:30.322080 9122 hybrid_clock.cc:648] HybridClock initialized: now 1786013130322023 us; error 54 us; skew 500 ppm
I20260806 10:45:30.322438 9122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:30 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:30.325472 9122 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:45:30.326925 9122 webserver.cc:460] Webserver started at http://127.16.45.66:36011/ using document root <none> and password file <none>
I20260806 10:45:30.327601 9122 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:30.327719 9122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:30.332937 9122 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 10:45:30.337493 9142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:30.338915 9122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:45:30.339077 9122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "4556271ef0df4923b9550a3ee709cfef"
format_stamp: "Formatted at 2026-08-06 10:44:44 on dist-test-slave-fgb3"
server_key: "638cc8f70f7e706486a5b402fadbcfca"
server_key_iv: "eeea66ec3f8639a82616a0574eb8616e"
server_key_version: "encryptionkey@0"
I20260806 10:45:30.340049 9122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:30.364095 9122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:30.368584 9122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:30.368855 9122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:30.369971 9122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:30.371475 9122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:30.371590 9122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:30.371691 9122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:30.371760 9122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:30.402199 9122 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:33381
I20260806 10:45:30.402364 9294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:33381 every 8 connection(s)
I20260806 10:45:30.403712 9122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:45:30.408619 9298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:30.406728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:35701)
0806 10:45:30.407478 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:30.407737 (+ 259us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":260,"threads_started":1}
W20260806 10:45:30.409296 9295 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:40843 (0 consecutive failures): Network error: Failed to ping master at 127.16.45.126:40843: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
I20260806 10:45:30.410171 9298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:30.409807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:52301)
0806 10:45:30.409975 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:30.410060 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 10:45:30.411108 9298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:30.410788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:35363)
0806 10:45:30.410913 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:30.410996 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 10:45:30.411412 9295 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 10:45:30.413573 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 9122
I20260806 10:45:30.414206 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:44151
--local_ip_for_outbound_sockets=127.16.45.67
--tserver_master_addrs=127.16.45.126:40843
--webserver_port=32857
--webserver_interface=127.16.45.67
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:45:30.744724 9299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:30.745045 9299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:30.745204 9299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:30.752424 9299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:30.752539 9299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:30.752691 9299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:45:30.762362 9299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:44151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=32857
--tserver_master_addrs=127.16.45.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:30.763607 9299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:30.764875 9299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:30.777804 9308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:30.777878 9306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:30.777896 9312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:30.778887 9299 server_base.cc:1034] running on GCE node
I20260806 10:45:30.779553 9299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:30.780490 9299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:30.781726 9299 hybrid_clock.cc:648] HybridClock initialized: now 1786013130781654 us; error 45 us; skew 500 ppm
I20260806 10:45:30.782058 9299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:30 dist-test-slave-fgb3 krb5kdc[7231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:30.785308 9299 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:45:30.786837 9299 webserver.cc:460] Webserver started at http://127.16.45.67:32857/ using document root <none> and password file <none>
I20260806 10:45:30.787689 9299 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:30.787806 9299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:30.793385 9299 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 10:45:30.796280 9321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:30.797748 9299 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:45:30.797920 9299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "bf8961e0426b4ce48057444649b1f612"
format_stamp: "Formatted at 2026-08-06 10:44:45 on dist-test-slave-fgb3"
server_key: "6cdabe86a08ce70f3fe9ee6390fd54f1"
server_key_iv: "a2a6f1defc6f7dc68649154b213d5b78"
server_key_version: "encryptionkey@0"
I20260806 10:45:30.799000 9299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:30.829907 9299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:30.834532 9299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:30.834806 9299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:30.835844 9299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:30.837301 9299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:30.837409 9299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:30.837519 9299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:30.837594 9299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:30.869666 9299 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:44151
I20260806 10:45:30.869726 9468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:44151 every 8 connection(s)
I20260806 10:45:30.871170 9299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:45:30.873673 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 9299
I20260806 10:45:30.876390 9472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:30.874212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:59929)
0806 10:45:30.875094 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:30.875349 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":310,"threads_started":1}
W20260806 10:45:30.877015 9470 heartbeater.cc:644] Failed to heartbeat to 127.16.45.126:40843 (0 consecutive failures): Network error: Failed to ping master at 127.16.45.126:40843: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
I20260806 10:45:30.877808 9472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:30.877494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:59333)
0806 10:45:30.877620 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:30.877688 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 10:45:30.878629 9472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:30.878261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:47865)
0806 10:45:30.878439 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:30.878519 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260806 10:45:30.878841 9470 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 10:45:30.941848 9474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:30.940970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:59045)
0806 10:45:30.941448 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:30.941555 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":226,"threads_started":1}
I20260806 10:45:31.412874 9477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:31.411928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:51205)
0806 10:45:31.412458 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:31.412572 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":247,"threads_started":1}
I20260806 10:45:31.880172 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:31.879380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:37263)
0806 10:45:31.879852 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:31.879947 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":207,"threads_started":1}
I20260806 10:45:31.943442 9483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:31.942726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:60325)
0806 10:45:31.943170 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:31.943278 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":217,"threads_started":1}
I20260806 10:45:32.414600 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:32.413825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:33405)
0806 10:45:32.414290 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:32.414426 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":223,"threads_started":1}
I20260806 10:45:32.881855 9485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:32.881100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:44083)
0806 10:45:32.881568 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:32.881658 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":229,"threads_started":1}
I20260806 10:45:32.945310 9487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:32.944413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:58003)
0806 10:45:32.944975 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:32.945089 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":247,"threads_started":1}
I20260806 10:45:33.416364 9488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:33.415529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:46615)
0806 10:45:33.416026 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:33.416123 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":275,"threads_started":1}
I20260806 10:45:33.883538 9489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:33.882754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:53315)
0806 10:45:33.883243 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:33.883342 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":244,"threads_started":1}
I20260806 10:45:33.946875 9491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:33.946103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:55633)
0806 10:45:33.946593 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:33.946681 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":264,"threads_started":1}
I20260806 10:45:34.418151 9492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:34.417333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:39349)
0806 10:45:34.417833 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:34.417926 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":246,"threads_started":1}
I20260806 10:45:34.885205 9496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:34.884436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:48769)
0806 10:45:34.884942 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:34.885030 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":280,"threads_started":1}
I20260806 10:45:34.948521 9497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:34.947787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:49233)
0806 10:45:34.948256 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:34.948343 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":235,"threads_started":1}
I20260806 10:45:35.419999 9499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:35.419229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:42429)
0806 10:45:35.419710 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:35.419821 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":239,"threads_started":1}
I20260806 10:45:35.886927 9501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:35.886160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:54677)
0806 10:45:35.886673 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:35.886755 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":298,"threads_started":1}
I20260806 10:45:35.950167 9502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:35.949448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:50473)
0806 10:45:35.949904 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:35.950001 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":225,"threads_started":1}
I20260806 10:45:36.421700 9504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:36.420886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:37209)
0806 10:45:36.421392 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:36.421490 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":234,"threads_started":1}
I20260806 10:45:36.888643 9505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:36.887838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:42977)
0806 10:45:36.888363 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:36.888463 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":287,"threads_started":1}
I20260806 10:45:36.951956 9506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:36.951124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:54607)
0806 10:45:36.951646 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:36.951733 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":246,"threads_started":1}
I20260806 10:45:37.423614 9507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:37.422762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:36213)
0806 10:45:37.423301 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:37.423391 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":241,"threads_started":1}
I20260806 10:45:37.890357 9508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:37.889487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:47981)
0806 10:45:37.889991 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:37.890083 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":224,"threads_started":1}
I20260806 10:45:37.953524 9509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:37.952843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:47883)
0806 10:45:37.953267 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:37.953352 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":221,"threads_started":1}
I20260806 10:45:38.425347 9511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:38.424572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:35221)
0806 10:45:38.425065 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:38.425155 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":259,"threads_started":1}
I20260806 10:45:38.892172 9513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:38.891333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:53331)
0806 10:45:38.891911 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:38.892004 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":288,"threads_started":1}
I20260806 10:45:38.955196 9516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:38.954374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:47883)
0806 10:45:38.954899 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:38.954993 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":240,"threads_started":1}
I20260806 10:45:39.427115 9517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:39.426288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:38297)
0806 10:45:39.426840 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:39.426930 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":247,"threads_started":1}
I20260806 10:45:39.893958 9519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:39.893101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:51745)
0806 10:45:39.893661 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:39.893780 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":291,"threads_started":1}
I20260806 10:45:39.957158 9521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:39.956329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:43707)
0806 10:45:39.956869 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:39.956978 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":320,"threads_started":1}
I20260806 10:45:40.428999 9522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:40.428192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:40827)
0806 10:45:40.428740 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:40.428831 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":330,"threads_started":1}
I20260806 10:45:40.895756 9523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:40.895001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:39301)
0806 10:45:40.895503 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:40.895592 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":277,"threads_started":1}
I20260806 10:45:40.958992 9525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:40.958098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:52545)
0806 10:45:40.958658 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:40.958771 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":322,"threads_started":1}
I20260806 10:45:41.430967 9526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:41.430087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:43025)
0806 10:45:41.430637 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:41.430769 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":305,"threads_started":1}
I20260806 10:45:41.897666 9527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:41.896840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:45305)
0806 10:45:41.897362 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:41.897468 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":240,"threads_started":1}
I20260806 10:45:41.960745 9528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:41.960012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:52977)
0806 10:45:41.960491 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:41.960585 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":243,"threads_started":1}
I20260806 10:45:42.432746 9529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:42.431957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:60505)
0806 10:45:42.432473 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:42.432570 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":277,"threads_started":1}
I20260806 10:45:42.899412 9531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:42.898665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:35363)
0806 10:45:42.899143 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:42.899238 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":241,"threads_started":1}
I20260806 10:45:42.962711 9532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:42.961808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:46571)
0806 10:45:42.962397 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:42.962520 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":256,"threads_started":1}
I20260806 10:45:43.434818 9534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:43.433816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:44505)
0806 10:45:43.434408 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:43.434539 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":262,"threads_started":1}
I20260806 10:45:43.901185 9536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:43.900407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:51883)
0806 10:45:43.900896 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:43.900998 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":232,"threads_started":1}
I20260806 10:45:43.964617 9537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:43.963731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:42979)
0806 10:45:43.964333 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:43.964417 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":370,"threads_started":1}
I20260806 10:45:44.436553 9538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:44.435761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:38849)
0806 10:45:44.436252 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:44.436358 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":249,"threads_started":1}
I20260806 10:45:44.902973 9541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:44.902150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:49717)
0806 10:45:44.902673 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:44.902779 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":288,"threads_started":1}
I20260806 10:45:44.966557 9543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:44.965757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.65:45649)
0806 10:45:44.966228 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:44.966367 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":253,"threads_started":1}
I20260806 10:45:45.438602 9544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:45.437715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.66:37795)
0806 10:45:45.438245 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:45.438413 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":277,"threads_started":1}
I20260806 10:45:45.880848 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 8883
I20260806 10:45:45.902977 9546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:45.882693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57974 (local address 127.16.45.65:42333)
0806 10:45:45.883229 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:45.883243 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:45.883281 (+ 38us) server_negotiation.cc:407] Connection header received
0806 10:45:45.884932 (+ 1651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:45.884942 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:45.885365 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:45.885686 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:45.887299 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:45.888536 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:45.889754 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:45.890481 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:45.890652 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:45.896901 (+ 6249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:45.896909 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:45.896926 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:45.896965 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:45.899738 (+ 2773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:45.900405 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:45.900412 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:45.900419 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:45.900589 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:45.900964 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:45.900967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:45.900969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:45.901494 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:45.901778 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:45.902260 (+ 482us) server_negotiation.cc:299] Negotiation successful
0806 10:45:45.902698 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":237,"threads_started":1}
I20260806 10:45:45.904616 9112 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:45.904870 9548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:45.904014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:40843 (local address 127.16.45.67:58769)
0806 10:45:45.904527 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:45.904641 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.126:40843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":253,"threads_started":1}
I20260806 10:45:45.987728 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 8883
I20260806 10:45:46.009618 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 9122
I20260806 10:45:46.027611 9551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:46.010748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60786 (local address 127.16.45.66:33381)
0806 10:45:46.011225 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:46.011239 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:46.011310 (+ 71us) server_negotiation.cc:407] Connection header received
0806 10:45:46.012747 (+ 1437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:46.012756 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:46.013164 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:46.013460 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:46.014824 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:46.016133 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:46.017501 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:46.018216 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:46.018441 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:46.021242 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:46.021251 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:46.021300 (+ 49us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:46.021345 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:46.024382 (+ 3037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:46.025153 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:46.025160 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:46.025167 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:46.025379 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:46.025727 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:46.025730 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:46.025732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:46.026256 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:46.026592 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:46.026958 (+ 366us) server_negotiation.cc:299] Negotiation successful
0806 10:45:46.027323 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":216,"threads_started":1}
I20260806 10:45:46.029057 9287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:46.111725 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 9122
I20260806 10:45:46.130098 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 9299
I20260806 10:45:46.148168 9555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:46.131075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42956 (local address 127.16.45.67:44151)
0806 10:45:46.131663 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:46.131677 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:46.131719 (+ 42us) server_negotiation.cc:407] Connection header received
0806 10:45:46.133370 (+ 1651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:46.133381 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:46.133805 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:46.134169 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:46.135709 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:46.136938 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:46.138264 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:46.139003 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:46.139192 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:46.141969 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:46.141976 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:46.141992 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:46.142035 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:46.144947 (+ 2912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:46.145654 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:46.145660 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:46.145667 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:46.145836 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:46.146183 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:46.146187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:46.146189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:46.146759 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:46.147051 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:46.147477 (+ 426us) server_negotiation.cc:299] Negotiation successful
0806 10:45:46.147869 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":275,"threads_started":1}
I20260806 10:45:46.149578 9463 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:46.232853 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 9299
2026-08-06T10:45:46Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64792 ms)
[----------] 30 tests from SecurityITest (305300 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:45:46 dist-test-slave-fgb3 krb5kdc[9563](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:45:46 dist-test-slave-fgb3 krb5kdc[9563](info): set up 2 sockets
Aug 06 10:45:46 dist-test-slave-fgb3 krb5kdc[9563](info): commencing operation
krb5kdc: starting...
W20260806 10:45:47.452215 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:45:47 dist-test-slave-fgb3 krb5kdc[9563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:45:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:45:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:45:47.755142 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:36407
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:34623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:36407
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:45:48.089406 9584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:48.089728 9584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:48.089862 9584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:48.097157 9584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:45:48.097286 9584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:48.097368 9584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:48.097451 9584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:45:48.097509 9584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:45:48.107651 9584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:36407
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:36407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:48.109088 9584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:48.110455 9584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:48.122782 9590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:48.122829 9595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:48.122859 9593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:48.123235 9584 server_base.cc:1034] running on GCE node
I20260806 10:45:48.124336 9584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:48.125932 9584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:48.127187 9584 hybrid_clock.cc:648] HybridClock initialized: now 1786013148127133 us; error 30 us; skew 500 ppm
I20260806 10:45:48.127591 9584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:48 dist-test-slave-fgb3 krb5kdc[9563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013148, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:48.130812 9584 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:45:48.132357 9584 webserver.cc:460] Webserver started at http://127.16.45.126:34083/ using document root <none> and password file <none>
I20260806 10:45:48.133085 9584 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:48.133200 9584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:48.133473 9584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:48.136662 9584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "783dc0ed58aa43fd96b6c6e9e28737c4"
format_stamp: "Formatted at 2026-08-06 10:45:48 on dist-test-slave-fgb3"
server_key: "90936a77a054b2ea9d5b4e18237ad7a1"
server_key_iv: "37c06e98d55d2d3e1ec239e67e0a8dbd"
server_key_version: "encryptionkey@0"
I20260806 10:45:48.137423 9584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "783dc0ed58aa43fd96b6c6e9e28737c4"
format_stamp: "Formatted at 2026-08-06 10:45:48 on dist-test-slave-fgb3"
server_key: "90936a77a054b2ea9d5b4e18237ad7a1"
server_key_iv: "37c06e98d55d2d3e1ec239e67e0a8dbd"
server_key_version: "encryptionkey@0"
I20260806 10:45:48.142917 9584 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 10:45:48.146545 9602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:48.148054 9584 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:45:48.148227 9584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "783dc0ed58aa43fd96b6c6e9e28737c4"
format_stamp: "Formatted at 2026-08-06 10:45:48 on dist-test-slave-fgb3"
server_key: "90936a77a054b2ea9d5b4e18237ad7a1"
server_key_iv: "37c06e98d55d2d3e1ec239e67e0a8dbd"
server_key_version: "encryptionkey@0"
I20260806 10:45:48.148444 9584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:48.176559 9584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:48.180910 9584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:48.181169 9584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:48.198962 9584 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:36407
I20260806 10:45:48.198982 9675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:36407 every 8 connection(s)
I20260806 10:45:48.200330 9584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:45:48.204154 9677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:48.204381 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 9584
I20260806 10:45:48.204612 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:45:48.205247 16565 external_mini_cluster.cc:1428] Setting key bab9405d8a7e98c0b77164320950fd8b
I20260806 10:45:48.218953 9677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4: Bootstrap starting.
Aug 06 10:45:48 dist-test-slave-fgb3 krb5kdc[9563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:45:48.222239 9677 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:48.223645 9677 log.cc:824] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:48.227511 9677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4: No bootstrap required, opened a new log
I20260806 10:45:48.231465 9682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:48.207448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42700 (local address 127.16.45.126:36407)
0806 10:45:48.208304 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:48.208320 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:48.208376 (+ 56us) server_negotiation.cc:407] Connection header received
0806 10:45:48.210863 (+ 2487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:48.210901 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:48.211504 (+ 603us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:48.212013 (+ 509us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:48.213503 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:48.215542 (+ 2039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:48.217072 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:48.218158 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:48.218376 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:48.222818 (+ 4442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:48.222830 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:48.222848 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:48.222898 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:48.226956 (+ 4058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:48.227833 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:48.227841 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:48.227847 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:48.228051 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:48.228475 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:48.228479 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:48.228481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:48.229050 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:48.229392 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:48.229887 (+ 495us) server_negotiation.cc:299] Negotiation successful
0806 10:45:48.230386 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":353,"threads_started":1}
I20260806 10:45:48.236320 9677 raft_consensus.cc:348] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "783dc0ed58aa43fd96b6c6e9e28737c4" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36407 } }
I20260806 10:45:48.236724 9677 raft_consensus.cc:374] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:48.236827 9677 raft_consensus.cc:729] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 783dc0ed58aa43fd96b6c6e9e28737c4, State: Initialized, Role: FOLLOWER
I20260806 10:45:48.237381 9677 consensus_queue.cc:260] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "783dc0ed58aa43fd96b6c6e9e28737c4" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36407 } }
I20260806 10:45:48.237613 9677 raft_consensus.cc:388] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:45:48.237739 9677 raft_consensus.cc:482] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:45:48.237900 9677 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:48.240694 9677 raft_consensus.cc:504] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "783dc0ed58aa43fd96b6c6e9e28737c4" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36407 } }
I20260806 10:45:48.241209 9677 leader_election.cc:302] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 783dc0ed58aa43fd96b6c6e9e28737c4; no voters:
I20260806 10:45:48.241894 9677 leader_election.cc:288] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:45:48.242012 9685 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:45:48.244014 9677 sys_catalog.cc:564] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:45:48.244436 9685 raft_consensus.cc:686] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [term 1 LEADER]: Becoming Leader. State: Replica: 783dc0ed58aa43fd96b6c6e9e28737c4, State: Running, Role: LEADER
I20260806 10:45:48.245059 9685 consensus_queue.cc:237] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "783dc0ed58aa43fd96b6c6e9e28737c4" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36407 } }
I20260806 10:45:48.248338 9687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "783dc0ed58aa43fd96b6c6e9e28737c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "783dc0ed58aa43fd96b6c6e9e28737c4" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36407 } } }
I20260806 10:45:48.248301 9688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 783dc0ed58aa43fd96b6c6e9e28737c4. Latest consensus state: current_term: 1 leader_uuid: "783dc0ed58aa43fd96b6c6e9e28737c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "783dc0ed58aa43fd96b6c6e9e28737c4" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 36407 } } }
I20260806 10:45:48.248765 9688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [sys.catalog]: This master's current role is: LEADER
I20260806 10:45:48.248765 9687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4 [sys.catalog]: This master's current role is: LEADER
I20260806 10:45:48.249682 9703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:45:48.258764 9703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:45:48.269346 9703 catalog_manager.cc:1347] Generated new cluster ID: 30ab5bcbfae44098a6d4b9ffc030cd2a
I20260806 10:45:48.269477 9703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:45:48.290570 9703 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:45:48.291975 9703 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:45:48.302369 9703 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4: Generated new TSK 0
I20260806 10:45:48.303383 9703 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:45:48.385492 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36407
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:34623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:45:48.719659 9714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:48.719937 9714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:48.720067 9714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:48.727490 9714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:48.727600 9714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:48.727726 9714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:45:48.737685 9714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36407
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:48.739055 9714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:48.740312 9714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:48.753837 9725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:48.753880 9721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:48.754029 9720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:48.754287 9714 server_base.cc:1034] running on GCE node
I20260806 10:45:48.755076 9714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:48.756006 9714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:48.757218 9714 hybrid_clock.cc:648] HybridClock initialized: now 1786013148757166 us; error 32 us; skew 500 ppm
I20260806 10:45:48.757537 9714 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:48 dist-test-slave-fgb3 krb5kdc[9563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013148, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:48.760651 9714 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:45:48.762156 9714 webserver.cc:460] Webserver started at http://127.16.45.65:42131/ using document root <none> and password file <none>
I20260806 10:45:48.762884 9714 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:48.763006 9714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:48.763303 9714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:48.766228 9714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "86c8e71d647e40389d79a99908fcb9e1"
format_stamp: "Formatted at 2026-08-06 10:45:48 on dist-test-slave-fgb3"
server_key: "6b322e677ec3e241b9902e8a752dd16b"
server_key_iv: "2a132ba9adfaa63fe2f942547c595645"
server_key_version: "encryptionkey@0"
I20260806 10:45:48.767026 9714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "86c8e71d647e40389d79a99908fcb9e1"
format_stamp: "Formatted at 2026-08-06 10:45:48 on dist-test-slave-fgb3"
server_key: "6b322e677ec3e241b9902e8a752dd16b"
server_key_iv: "2a132ba9adfaa63fe2f942547c595645"
server_key_version: "encryptionkey@0"
I20260806 10:45:48.772166 9714 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:45:48.775969 9735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:48.777417 9714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 10:45:48.777582 9714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "86c8e71d647e40389d79a99908fcb9e1"
format_stamp: "Formatted at 2026-08-06 10:45:48 on dist-test-slave-fgb3"
server_key: "6b322e677ec3e241b9902e8a752dd16b"
server_key_iv: "2a132ba9adfaa63fe2f942547c595645"
server_key_version: "encryptionkey@0"
I20260806 10:45:48.777769 9714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:48.797700 9714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:48.802412 9714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:48.802744 9714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:48.803813 9714 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:48.805296 9714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:48.805382 9714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:48.805485 9714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:48.805534 9714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:48.837853 9714 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:39963
I20260806 10:45:48.837886 9894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:39963 every 8 connection(s)
I20260806 10:45:48.839308 9714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:45:48.844738 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 9714
I20260806 10:45:48.844957 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:45:48.845654 16565 external_mini_cluster.cc:1428] Setting key 4118044d54e9c86b93ba04a05f07fb41
Aug 06 10:45:48 dist-test-slave-fgb3 krb5kdc[9563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013148, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:45:48.859555 9897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:48.841970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:35489 (local address 127.16.45.126:36407)
0806 10:45:48.842486 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:48.842493 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:48.843382 (+ 889us) server_negotiation.cc:407] Connection header received
0806 10:45:48.845262 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:48.845268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:48.845355 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:48.845449 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:48.847187 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:48.848083 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:48.849598 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:48.850005 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:48.850111 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:48.853632 (+ 3521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:48.853636 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:48.853640 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:48.853673 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:48.856407 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:48.857141 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:48.857147 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:48.857149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:48.857273 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:48.857725 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:48.857728 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:48.857730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:48.858018 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:48.858152 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:48.858955 (+ 803us) server_negotiation.cc:299] Negotiation successful
0806 10:45:48.859202 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":218,"threads_started":1}
I20260806 10:45:48.860535 9898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:48.842481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36407 (local address 127.16.45.65:35489)
0806 10:45:48.843197 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:48.843234 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:48.844999 (+ 1765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:48.845707 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:48.845720 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:48.846291 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:48.847025 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:48.847044 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:48.848229 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:48.848235 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:48.849463 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:48.849476 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:48.850226 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:48.850233 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:48.850510 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:48.851148 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:45:48.851176 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:48.853411 (+ 2235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:48.856545 (+ 3134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:48.856555 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:48.856574 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:48.857016 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:48.857417 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:48.857421 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:48.857423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:48.857611 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:48.858142 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:48.858150 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:48.858557 (+ 407us) client_negotiation.cc:769] Sending connection context
0806 10:45:48.858800 (+ 243us) client_negotiation.cc:240] Negotiation successful
0806 10:45:48.859359 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":272,"threads_started":1}
I20260806 10:45:48.862066 9895 heartbeater.cc:347] Connected to a master server at 127.16.45.126:36407
I20260806 10:45:48.862461 9895 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:48.863279 9895 heartbeater.cc:511] Master 127.16.45.126:36407 requested a full tablet report, sending...
I20260806 10:45:48.865850 9626 ts_manager.cc:194] Registered new tserver with Master: 86c8e71d647e40389d79a99908fcb9e1 (127.16.45.65:39963)
I20260806 10:45:48.867844 9626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:35489
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:45:48.913672 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36407
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:34623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:45:49.256994 9901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:49.257284 9901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:49.257419 9901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:49.265024 9901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:49.265136 9901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:49.265300 9901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:45:49.275048 9901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36407
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:49.276391 9901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:49.277686 9901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:49.291172 9906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:49.291240 9911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:49.291200 9907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:49.292181 9901 server_base.cc:1034] running on GCE node
I20260806 10:45:49.292749 9901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:49.293691 9901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:49.294904 9901 hybrid_clock.cc:648] HybridClock initialized: now 1786013149294852 us; error 44 us; skew 500 ppm
I20260806 10:45:49.295214 9901 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:49 dist-test-slave-fgb3 krb5kdc[9563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013149, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:49.298436 9901 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:45:49.299866 9901 webserver.cc:460] Webserver started at http://127.16.45.66:44045/ using document root <none> and password file <none>
I20260806 10:45:49.300516 9901 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:49.300637 9901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:49.300944 9901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:49.303831 9901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "b1d59f74d3f2436f9f1caa78d27e3611"
format_stamp: "Formatted at 2026-08-06 10:45:49 on dist-test-slave-fgb3"
server_key: "36104484a7135d55467461bb3eb361cb"
server_key_iv: "b2cc0900b124512f11970bb501399021"
server_key_version: "encryptionkey@0"
I20260806 10:45:49.304559 9901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "b1d59f74d3f2436f9f1caa78d27e3611"
format_stamp: "Formatted at 2026-08-06 10:45:49 on dist-test-slave-fgb3"
server_key: "36104484a7135d55467461bb3eb361cb"
server_key_iv: "b2cc0900b124512f11970bb501399021"
server_key_version: "encryptionkey@0"
I20260806 10:45:49.309561 9901 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:45:49.313362 9922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:49.315055 9901 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:45:49.315269 9901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "b1d59f74d3f2436f9f1caa78d27e3611"
format_stamp: "Formatted at 2026-08-06 10:45:49 on dist-test-slave-fgb3"
server_key: "36104484a7135d55467461bb3eb361cb"
server_key_iv: "b2cc0900b124512f11970bb501399021"
server_key_version: "encryptionkey@0"
I20260806 10:45:49.315526 9901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:49.332304 9901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:49.336512 9901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:49.336786 9901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:49.337759 9901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:49.339139 9901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:49.339217 9901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:49.339344 9901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:49.339404 9901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:49.369463 9901 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:37543
I20260806 10:45:49.369500 10082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:37543 every 8 connection(s)
I20260806 10:45:49.370770 9901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:45:49.373672 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 9901
I20260806 10:45:49.373836 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:45:49.374246 16565 external_mini_cluster.cc:1428] Setting key 1c3a6eae8d39777f6c5e4b9114994be1
Aug 06 10:45:49 dist-test-slave-fgb3 krb5kdc[9563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013149, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:45:49.391942 10085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:49.373213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:44599 (local address 127.16.45.126:36407)
0806 10:45:49.373727 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:49.373733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:49.374691 (+ 958us) server_negotiation.cc:407] Connection header received
0806 10:45:49.376655 (+ 1964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:49.376660 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:49.376743 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:49.376881 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:49.378270 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.379309 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.380864 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.381489 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.381605 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:49.385528 (+ 3923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:49.385534 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:49.385538 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:49.385578 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:49.388657 (+ 3079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:49.389595 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:49.389599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:49.389602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:49.389731 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:49.390197 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:49.390200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:49.390202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:49.390516 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:49.390625 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:49.391483 (+ 858us) server_negotiation.cc:299] Negotiation successful
0806 10:45:49.391653 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":253,"threads_started":1}
I20260806 10:45:49.393352 10086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:49.373668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36407 (local address 127.16.45.66:44599)
0806 10:45:49.374518 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:49.374562 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:49.376409 (+ 1847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:49.377049 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:49.377057 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:49.377541 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:49.378101 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:49.378120 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.379477 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.379481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:49.380712 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:49.380724 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.381743 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.381750 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:49.381985 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:49.382768 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:45:49.382795 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:49.385271 (+ 2476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:49.388824 (+ 3553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:49.388835 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:49.388855 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:49.389480 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:49.389833 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:49.389838 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:49.389841 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:49.390104 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:49.390647 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:49.390655 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:49.391110 (+ 455us) client_negotiation.cc:769] Sending connection context
0806 10:45:49.391428 (+ 318us) client_negotiation.cc:240] Negotiation successful
0806 10:45:49.391972 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":315,"threads_started":1}
I20260806 10:45:49.394863 10083 heartbeater.cc:347] Connected to a master server at 127.16.45.126:36407
I20260806 10:45:49.395160 10083 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:49.395903 10083 heartbeater.cc:511] Master 127.16.45.126:36407 requested a full tablet report, sending...
I20260806 10:45:49.397403 9626 ts_manager.cc:194] Registered new tserver with Master: b1d59f74d3f2436f9f1caa78d27e3611 (127.16.45.66:37543)
I20260806 10:45:49.398239 9626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:44599
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:45:49.442204 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36407
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:34623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:45:49.788074 10091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:49.788383 10091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:49.788520 10091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:49.795982 10091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:49.796110 10091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:49.796275 10091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:45:49.806056 10091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:36407
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:49.807412 10091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:49.808708 10091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:49.821874 10102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:49.821971 10097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:49.821939 10098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:49.823069 10091 server_base.cc:1034] running on GCE node
I20260806 10:45:49.823724 10091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:49.824668 10091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:49.825877 10091 hybrid_clock.cc:648] HybridClock initialized: now 1786013149825815 us; error 57 us; skew 500 ppm
I20260806 10:45:49.826182 10091 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:49 dist-test-slave-fgb3 krb5kdc[9563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013149, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:49.829376 10091 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:45:49.830963 10091 webserver.cc:460] Webserver started at http://127.16.45.67:37141/ using document root <none> and password file <none>
I20260806 10:45:49.831662 10091 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:49.831784 10091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:49.832101 10091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:49.835099 10091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "a1d63166f9dc450e8f3b1f9eb29173ef"
format_stamp: "Formatted at 2026-08-06 10:45:49 on dist-test-slave-fgb3"
server_key: "5a6e7ad5afdb5040c1d2ae47ced5a791"
server_key_iv: "a5b3f827e38ea10f10e1ccf151bdd4e5"
server_key_version: "encryptionkey@0"
I20260806 10:45:49.835879 10091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "a1d63166f9dc450e8f3b1f9eb29173ef"
format_stamp: "Formatted at 2026-08-06 10:45:49 on dist-test-slave-fgb3"
server_key: "5a6e7ad5afdb5040c1d2ae47ced5a791"
server_key_iv: "a5b3f827e38ea10f10e1ccf151bdd4e5"
server_key_version: "encryptionkey@0"
I20260806 10:45:49.841334 10091 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:45:49.845069 10109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:49.846614 10091 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:45:49.846787 10091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "a1d63166f9dc450e8f3b1f9eb29173ef"
format_stamp: "Formatted at 2026-08-06 10:45:49 on dist-test-slave-fgb3"
server_key: "5a6e7ad5afdb5040c1d2ae47ced5a791"
server_key_iv: "a5b3f827e38ea10f10e1ccf151bdd4e5"
server_key_version: "encryptionkey@0"
I20260806 10:45:49.846982 10091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:49.857851 10091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:49.862381 10091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:49.862661 10091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:49.863637 10091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:49.865005 10091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:49.865085 10091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:49.865201 10091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:49.865259 10091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:49.871507 9895 heartbeater.cc:503] Master 127.16.45.126:36407 was elected leader, sending a full tablet report...
I20260806 10:45:49.898662 10091 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:44845
I20260806 10:45:49.898707 10264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:44845 every 8 connection(s)
I20260806 10:45:49.899932 10091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:45:49.903056 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 10091
I20260806 10:45:49.903254 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:45:49.903847 16565 external_mini_cluster.cc:1428] Setting key 704450ff85f17a6aebf8846de4ff8dbb
Aug 06 10:45:49 dist-test-slave-fgb3 krb5kdc[9563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013149, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:45:49.919893 10270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:49.902400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:36831 (local address 127.16.45.126:36407)
0806 10:45:49.902838 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:49.902843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:49.903916 (+ 1073us) server_negotiation.cc:407] Connection header received
0806 10:45:49.906079 (+ 2163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:49.906083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:49.906166 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:49.906250 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:49.907910 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.908654 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.910230 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.910712 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.910811 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:49.914120 (+ 3309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:49.914125 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:49.914128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:49.914161 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:49.916699 (+ 2538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:49.917428 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:49.917433 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:49.917435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:49.917561 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:49.918051 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:49.918057 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:49.918061 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:49.918482 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:49.918661 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:49.919460 (+ 799us) server_negotiation.cc:299] Negotiation successful
0806 10:45:49.919626 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":208,"threads_started":1}
I20260806 10:45:49.920997 10272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:49.902884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:36407 (local address 127.16.45.67:36831)
0806 10:45:49.903746 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:49.903792 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:49.905819 (+ 2027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:49.906536 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:49.906547 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:49.907162 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:49.907764 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:49.907781 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.908802 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.908806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:49.910071 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:49.910088 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.910930 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.910935 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:49.911149 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:49.911775 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:45:49.911797 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:49.913906 (+ 2109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:49.916822 (+ 2916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:49.916829 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:49.916840 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:49.917294 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:49.917672 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:49.917675 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:49.917678 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:49.917922 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:49.918616 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:49.918622 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:49.919016 (+ 394us) client_negotiation.cc:769] Sending connection context
0806 10:45:49.919378 (+ 362us) client_negotiation.cc:240] Negotiation successful
0806 10:45:49.919789 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":406,"threads_started":1}
I20260806 10:45:49.922175 10267 heartbeater.cc:347] Connected to a master server at 127.16.45.126:36407
I20260806 10:45:49.922509 10267 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:49.923298 10267 heartbeater.cc:511] Master 127.16.45.126:36407 requested a full tablet report, sending...
I20260806 10:45:49.924733 9626 ts_manager.cc:194] Registered new tserver with Master: a1d63166f9dc450e8f3b1f9eb29173ef (127.16.45.67:44845)
I20260806 10:45:49.925531 9626 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:36831
I20260806 10:45:49.931309 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:45:49.948261 10270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:49.935698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42708 (local address 127.16.45.126:36407)
0806 10:45:49.935848 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:49.935854 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:49.936278 (+ 424us) server_negotiation.cc:407] Connection header received
0806 10:45:49.936440 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:49.936445 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:49.936514 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:49.936594 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:49.938055 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.938839 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.940112 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.940529 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.940638 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:49.942989 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:49.942994 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:49.942998 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:49.943031 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:49.945645 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:49.946373 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:49.946378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:49.946380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:49.946499 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:49.946851 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:49.946855 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:49.946859 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:49.947176 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:49.947421 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:49.947739 (+ 318us) server_negotiation.cc:299] Negotiation successful
0806 10:45:49.947956 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 10:45:49.952423 9626 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42708:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:45:49.959376 9626 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:45:49.993497 10291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:49.971828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53192 (local address 127.16.45.66:37543)
0806 10:45:49.984624 (+ 12796us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:49.984635 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:49.985854 (+ 1219us) server_negotiation.cc:407] Connection header received
0806 10:45:49.986182 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:49.986191 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:49.986453 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:49.986628 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:49.987406 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.988930 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.991184 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.992340 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.992476 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:49.992674 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:49.992983 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 10:45:49.993157 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12638,"thread_start_us":12508,"threads_started":1}
I20260806 10:45:49.993557 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:49.971161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:37543 (local address 127.0.0.1:53192)
0806 10:45:49.985695 (+ 14534us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:49.985723 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:49.985975 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:49.986707 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:49.986715 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:49.986744 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:49.987177 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:49.987193 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.989120 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.989125 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:49.991029 (+ 1904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:49.991041 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.992537 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.992543 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:49.992727 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:49.992780 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 10:45:49.992916 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 10:45:49.993106 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14403,"mutex_wait_us":1,"thread_start_us":14948,"threads_started":1}
I20260806 10:45:49.994303 10288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:49.971522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:44845 (local address 127.0.0.1:57872)
0806 10:45:49.986410 (+ 14888us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:49.986427 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:49.986549 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:49.987206 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:49.987210 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:49.987244 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:49.987672 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:49.987686 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.989520 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.989525 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:49.991759 (+ 2234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:49.991769 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.993463 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.993470 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:49.993643 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:49.993677 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 10:45:49.993772 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 10:45:49.993892 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14766,"mutex_wait_us":44,"thread_start_us":13878,"threads_started":1}
I20260806 10:45:49.994522 10286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:49.970742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:39963 (local address 127.0.0.1:43098)
0806 10:45:49.983877 (+ 13135us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:49.983935 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:49.984142 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:49.986908 (+ 2766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:49.986912 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:49.986937 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:49.987388 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:49.987399 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.989107 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.989112 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:49.991717 (+ 2605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:49.991736 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.993700 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.993706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:49.993858 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:49.993890 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 10:45:49.993976 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 10:45:49.994101 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12836,"mutex_wait_us":117,"thread_start_us":12701,"threads_started":1}
I20260806 10:45:49.995221 10290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:49.971738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57872 (local address 127.16.45.67:44845)
0806 10:45:49.985232 (+ 13494us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:49.985241 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:49.986538 (+ 1297us) server_negotiation.cc:407] Connection header received
0806 10:45:49.986737 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:49.986745 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:49.986944 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:49.987113 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:49.987869 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.989376 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.991907 (+ 2531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.993004 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.993120 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:49.993321 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:49.994760 (+ 1439us) server_negotiation.cc:299] Negotiation successful
0806 10:45:49.994925 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13310,"thread_start_us":13129,"threads_started":1}
I20260806 10:45:49.995234 10287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:49.971123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43098 (local address 127.16.45.65:39963)
0806 10:45:49.986081 (+ 14958us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:49.986089 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:49.986118 (+ 29us) server_negotiation.cc:407] Connection header received
0806 10:45:49.986211 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:49.986218 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:49.986486 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:49.986667 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:49.987586 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.988944 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.991891 (+ 2947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:49.993190 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:49.993322 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:49.993539 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:49.994774 (+ 1235us) server_negotiation.cc:299] Negotiation successful
0806 10:45:49.994931 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14803,"thread_start_us":14655,"threads_started":1}
I20260806 10:45:49.998014 9992 tablet_service.cc:1467] Processing CreateTablet for tablet 13ea96ac8fa145eb9e205200e36d495d (DEFAULT_TABLE table=test-table [id=60341385fe7d4994b7d75b4001687303]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:45:49.998155 9798 tablet_service.cc:1467] Processing CreateTablet for tablet 13ea96ac8fa145eb9e205200e36d495d (DEFAULT_TABLE table=test-table [id=60341385fe7d4994b7d75b4001687303]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:45:49.998690 10176 tablet_service.cc:1467] Processing CreateTablet for tablet 13ea96ac8fa145eb9e205200e36d495d (DEFAULT_TABLE table=test-table [id=60341385fe7d4994b7d75b4001687303]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:45:49.999480 9798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13ea96ac8fa145eb9e205200e36d495d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:49.999502 9992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13ea96ac8fa145eb9e205200e36d495d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:50.000054 10176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13ea96ac8fa145eb9e205200e36d495d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:50.014053 10293 tablet_bootstrap.cc:492] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611: Bootstrap starting.
I20260806 10:45:50.014911 10292 tablet_bootstrap.cc:492] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1: Bootstrap starting.
I20260806 10:45:50.015611 10295 tablet_bootstrap.cc:492] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef: Bootstrap starting.
I20260806 10:45:50.018700 10295 tablet_bootstrap.cc:654] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:50.018700 10293 tablet_bootstrap.cc:654] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:50.018699 10292 tablet_bootstrap.cc:654] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:50.019901 10295 log.cc:824] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:50.019949 10292 log.cc:824] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:50.019948 10293 log.cc:824] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:50.023638 10295 tablet_bootstrap.cc:492] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef: No bootstrap required, opened a new log
I20260806 10:45:50.023983 10295 ts_tablet_manager.cc:1397] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 10:45:50.024295 10293 tablet_bootstrap.cc:492] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611: No bootstrap required, opened a new log
I20260806 10:45:50.024540 10293 ts_tablet_manager.cc:1397] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260806 10:45:50.024829 10292 tablet_bootstrap.cc:492] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1: No bootstrap required, opened a new log
I20260806 10:45:50.025090 10292 ts_tablet_manager.cc:1397] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260806 10:45:50.031620 10293 raft_consensus.cc:348] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c8e71d647e40389d79a99908fcb9e1" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 39963 } } peers { permanent_uuid: "b1d59f74d3f2436f9f1caa78d27e3611" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 37543 } } peers { permanent_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44845 } }
I20260806 10:45:50.032032 10293 raft_consensus.cc:374] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:50.032155 10293 raft_consensus.cc:729] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1d59f74d3f2436f9f1caa78d27e3611, State: Initialized, Role: FOLLOWER
I20260806 10:45:50.032857 10293 consensus_queue.cc:260] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c8e71d647e40389d79a99908fcb9e1" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 39963 } } peers { permanent_uuid: "b1d59f74d3f2436f9f1caa78d27e3611" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 37543 } } peers { permanent_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44845 } }
I20260806 10:45:50.034150 10083 heartbeater.cc:503] Master 127.16.45.126:36407 was elected leader, sending a full tablet report...
I20260806 10:45:50.034873 10293 ts_tablet_manager.cc:1428] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611: Time spent starting tablet: real 0.010s user 0.007s sys 0.005s
I20260806 10:45:50.034729 10295 raft_consensus.cc:348] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c8e71d647e40389d79a99908fcb9e1" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 39963 } } peers { permanent_uuid: "b1d59f74d3f2436f9f1caa78d27e3611" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 37543 } } peers { permanent_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44845 } }
I20260806 10:45:50.035254 10295 raft_consensus.cc:374] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:50.035406 10295 raft_consensus.cc:729] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1d63166f9dc450e8f3b1f9eb29173ef, State: Initialized, Role: FOLLOWER
I20260806 10:45:50.035516 10292 raft_consensus.cc:348] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c8e71d647e40389d79a99908fcb9e1" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 39963 } } peers { permanent_uuid: "b1d59f74d3f2436f9f1caa78d27e3611" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 37543 } } peers { permanent_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44845 } }
I20260806 10:45:50.035980 10292 raft_consensus.cc:374] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:50.036106 10292 raft_consensus.cc:729] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c8e71d647e40389d79a99908fcb9e1, State: Initialized, Role: FOLLOWER
I20260806 10:45:50.036343 10295 consensus_queue.cc:260] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c8e71d647e40389d79a99908fcb9e1" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 39963 } } peers { permanent_uuid: "b1d59f74d3f2436f9f1caa78d27e3611" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 37543 } } peers { permanent_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44845 } }
I20260806 10:45:50.036727 10292 consensus_queue.cc:260] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c8e71d647e40389d79a99908fcb9e1" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 39963 } } peers { permanent_uuid: "b1d59f74d3f2436f9f1caa78d27e3611" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 37543 } } peers { permanent_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44845 } }
I20260806 10:45:50.037621 10267 heartbeater.cc:503] Master 127.16.45.126:36407 was elected leader, sending a full tablet report...
I20260806 10:45:50.038466 10295 ts_tablet_manager.cc:1428] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef: Time spent starting tablet: real 0.014s user 0.007s sys 0.008s
I20260806 10:45:50.040401 10292 ts_tablet_manager.cc:1428] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260806 10:45:50.046427 10305 raft_consensus.cc:482] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:45:50.046754 10305 raft_consensus.cc:504] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c8e71d647e40389d79a99908fcb9e1" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 39963 } } peers { permanent_uuid: "b1d59f74d3f2436f9f1caa78d27e3611" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 37543 } } peers { permanent_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44845 } }
I20260806 10:45:50.048463 10305 leader_election.cc:288] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86c8e71d647e40389d79a99908fcb9e1 (127.16.45.65:39963), b1d59f74d3f2436f9f1caa78d27e3611 (127.16.45.66:37543)
I20260806 10:45:50.055038 10272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:50.048956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:37543 (local address 127.16.45.67:44509)
0806 10:45:50.049142 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:50.049166 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:50.049329 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:50.049654 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:50.049659 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:50.049698 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:50.049954 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:50.049970 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.051318 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.051323 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:50.053333 (+ 2010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:50.053349 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.054486 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.054490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:50.054626 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:50.054653 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 10:45:50.054725 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 10:45:50.054827 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":1}
I20260806 10:45:50.055179 10291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:50.048875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:44509 (local address 127.16.45.66:37543)
0806 10:45:50.049073 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:50.049079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:50.049305 (+ 226us) server_negotiation.cc:407] Connection header received
0806 10:45:50.049446 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:50.049450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:50.049515 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:50.049598 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:50.050117 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.051173 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.053486 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.054351 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.054507 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:50.054593 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:50.054768 (+ 175us) server_negotiation.cc:299] Negotiation successful
0806 10:45:50.054908 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:45:50.056263 10309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:50.048956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:39963 (local address 127.16.45.67:51237)
0806 10:45:50.050136 (+ 1180us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:50.050154 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:50.050288 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:50.050661 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:50.050666 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:50.050693 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:50.051090 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:50.051102 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.052539 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.052544 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:50.054143 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:50.054155 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.055661 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.055667 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:50.055831 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:50.055854 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 10:45:50.055926 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 10:45:50.056011 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1059,"mutex_wait_us":472,"thread_start_us":415,"threads_started":1}
I20260806 10:45:50.056349 10287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:50.048875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:51237 (local address 127.16.45.65:39963)
0806 10:45:50.049073 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:50.049079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:50.050285 (+ 1206us) server_negotiation.cc:407] Connection header received
0806 10:45:50.050464 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:50.050468 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:50.050534 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:50.050616 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:50.051260 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.052354 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.054303 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.055475 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.055606 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:50.055654 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:50.055978 (+ 324us) server_negotiation.cc:299] Negotiation successful
0806 10:45:50.056120 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:45:50.056291 10019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13ea96ac8fa145eb9e205200e36d495d" candidate_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d59f74d3f2436f9f1caa78d27e3611" is_pre_election: true
I20260806 10:45:50.056855 10019 raft_consensus.cc:2454] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1d63166f9dc450e8f3b1f9eb29173ef in term 0.
I20260806 10:45:50.057569 10116 leader_election.cc:302] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1d63166f9dc450e8f3b1f9eb29173ef, b1d59f74d3f2436f9f1caa78d27e3611; no voters:
I20260806 10:45:50.057519 9828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13ea96ac8fa145eb9e205200e36d495d" candidate_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c8e71d647e40389d79a99908fcb9e1" is_pre_election: true
I20260806 10:45:50.057925 10305 raft_consensus.cc:2781] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:45:50.058054 10305 raft_consensus.cc:482] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:45:50.058012 9828 raft_consensus.cc:2454] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1d63166f9dc450e8f3b1f9eb29173ef in term 0.
I20260806 10:45:50.058125 10305 raft_consensus.cc:3037] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:50.060408 10305 raft_consensus.cc:504] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c8e71d647e40389d79a99908fcb9e1" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 39963 } } peers { permanent_uuid: "b1d59f74d3f2436f9f1caa78d27e3611" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 37543 } } peers { permanent_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44845 } }
I20260806 10:45:50.060976 10305 leader_election.cc:288] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [CANDIDATE]: Term 1 election: Requested vote from peers 86c8e71d647e40389d79a99908fcb9e1 (127.16.45.65:39963), b1d59f74d3f2436f9f1caa78d27e3611 (127.16.45.66:37543)
I20260806 10:45:50.061373 9828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13ea96ac8fa145eb9e205200e36d495d" candidate_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86c8e71d647e40389d79a99908fcb9e1"
I20260806 10:45:50.061472 10019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13ea96ac8fa145eb9e205200e36d495d" candidate_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1d59f74d3f2436f9f1caa78d27e3611"
I20260806 10:45:50.061558 9828 raft_consensus.cc:3037] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:50.061674 10019 raft_consensus.cc:3037] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:50.063879 9828 raft_consensus.cc:2454] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1d63166f9dc450e8f3b1f9eb29173ef in term 1.
I20260806 10:45:50.063942 10019 raft_consensus.cc:2454] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1d63166f9dc450e8f3b1f9eb29173ef in term 1.
I20260806 10:45:50.064288 10115 leader_election.cc:302] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c8e71d647e40389d79a99908fcb9e1, a1d63166f9dc450e8f3b1f9eb29173ef; no voters:
I20260806 10:45:50.064651 10305 raft_consensus.cc:2781] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:45:50.065157 10305 raft_consensus.cc:686] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 1 LEADER]: Becoming Leader. State: Replica: a1d63166f9dc450e8f3b1f9eb29173ef, State: Running, Role: LEADER
I20260806 10:45:50.065717 10305 consensus_queue.cc:237] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c8e71d647e40389d79a99908fcb9e1" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 39963 } } peers { permanent_uuid: "b1d59f74d3f2436f9f1caa78d27e3611" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 37543 } } peers { permanent_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44845 } }
I20260806 10:45:50.070827 9625 catalog_manager.cc:5495] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef reported cstate change: term changed from 0 to 1, leader changed from <none> to a1d63166f9dc450e8f3b1f9eb29173ef (127.16.45.67). New cstate: current_term: 1 leader_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c8e71d647e40389d79a99908fcb9e1" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 39963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1d59f74d3f2436f9f1caa78d27e3611" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 37543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1d63166f9dc450e8f3b1f9eb29173ef" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 44845 } health_report { overall_health: HEALTHY } } }
W20260806 10:45:50.091804 9896 tablet.cc:2369] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:45:50.109280 10290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:50.104098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57880 (local address 127.16.45.67:44845)
0806 10:45:50.104269 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:50.104273 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:50.104291 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:45:50.104484 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:50.104487 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:50.104579 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:50.104704 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:45:50.105060 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.105778 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.107293 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.107688 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.107788 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:50.108268 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:45:50.108787 (+ 519us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:45:50.108894 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:50.109005 (+ 111us) server_negotiation.cc:299] Negotiation successful
0806 10:45:50.109075 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 10:45:50.117311 9828 raft_consensus.cc:1261] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1 [term 1 FOLLOWER]: Refusing update from remote peer a1d63166f9dc450e8f3b1f9eb29173ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:45:50.117306 10019 raft_consensus.cc:1261] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611 [term 1 FOLLOWER]: Refusing update from remote peer a1d63166f9dc450e8f3b1f9eb29173ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:45:50.118278 10310 consensus_queue.cc:1035] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1d59f74d3f2436f9f1caa78d27e3611" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 37543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:45:50.118726 10305 consensus_queue.cc:1035] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "86c8e71d647e40389d79a99908fcb9e1" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 39963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 10:45:50.122558 10084 tablet.cc:2369] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:45:50.129526 10315 mvcc.cc:205] Tried to move back new op lower bound from 7315509862870953984 to 7315509862673719296. Current Snapshot: MvccSnapshot[applied={T|T < 7315509862870953984}]
I20260806 10:45:50.137609 10317 mvcc.cc:205] Tried to move back new op lower bound from 7315509862870953984 to 7315509862673719296. Current Snapshot: MvccSnapshot[applied={T|T < 7315509862870953984}]
I20260806 10:45:50.143682 9625 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:45:50.144016 9625 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42708:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:45:50.147881 9625 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 783dc0ed58aa43fd96b6c6e9e28737c4: Sending DeleteTablet for 3 replicas of tablet 13ea96ac8fa145eb9e205200e36d495d
I20260806 10:45:50.149006 9798 tablet_service.cc:1514] Processing DeleteTablet for tablet 13ea96ac8fa145eb9e205200e36d495d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:45:50 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:43098
I20260806 10:45:50.149021 10176 tablet_service.cc:1514] Processing DeleteTablet for tablet 13ea96ac8fa145eb9e205200e36d495d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:45:50 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:57872
I20260806 10:45:50.149753 9992 tablet_service.cc:1514] Processing DeleteTablet for tablet 13ea96ac8fa145eb9e205200e36d495d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:45:50 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:53192
I20260806 10:45:50.150146 10325 tablet_replica.cc:330] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1: stopping tablet replica
I20260806 10:45:50.150674 10325 raft_consensus.cc:2229] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:45:50.151206 10325 raft_consensus.cc:2258] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:45:50.152206 10326 tablet_replica.cc:330] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef: stopping tablet replica
I20260806 10:45:50.152232 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 9714
I20260806 10:45:50.152658 10326 raft_consensus.cc:2229] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:45:50.153424 10326 raft_consensus.cc:2258] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:45:50.154667 10325 ts_tablet_manager.cc:1905] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:45:50.155337 10326 ts_tablet_manager.cc:1905] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:45:50.160706 10325 ts_tablet_manager.cc:1918] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:45:50.161052 10325 log.cc:1196] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/13ea96ac8fa145eb9e205200e36d495d
I20260806 10:45:50.161690 10325 ts_tablet_manager.cc:1939] T 13ea96ac8fa145eb9e205200e36d495d P 86c8e71d647e40389d79a99908fcb9e1: Deleting consensus metadata
I20260806 10:45:50.162817 10326 ts_tablet_manager.cc:1918] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:45:50.163087 10326 log.cc:1196] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/13ea96ac8fa145eb9e205200e36d495d
I20260806 10:45:50.163686 10326 ts_tablet_manager.cc:1939] T 13ea96ac8fa145eb9e205200e36d495d P a1d63166f9dc450e8f3b1f9eb29173ef: Deleting consensus metadata
I20260806 10:45:50.163847 9606 catalog_manager.cc:4841] TS 86c8e71d647e40389d79a99908fcb9e1 (127.16.45.65:39963): tablet 13ea96ac8fa145eb9e205200e36d495d (table test-table [id=60341385fe7d4994b7d75b4001687303]) successfully deleted
I20260806 10:45:50.165282 9603 catalog_manager.cc:4841] TS a1d63166f9dc450e8f3b1f9eb29173ef (127.16.45.67:44845): tablet 13ea96ac8fa145eb9e205200e36d495d (table test-table [id=60341385fe7d4994b7d75b4001687303]) successfully deleted
I20260806 10:45:50.166296 10328 tablet_replica.cc:330] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611: stopping tablet replica
I20260806 10:45:50.166739 10328 raft_consensus.cc:2229] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:45:50.167172 10328 raft_consensus.cc:2258] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:45:50.169267 10328 ts_tablet_manager.cc:1905] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:45:50.174608 10328 ts_tablet_manager.cc:1918] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:45:50.174762 10328 log.cc:1196] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/13ea96ac8fa145eb9e205200e36d495d
I20260806 10:45:50.175305 10328 ts_tablet_manager.cc:1939] T 13ea96ac8fa145eb9e205200e36d495d P b1d59f74d3f2436f9f1caa78d27e3611: Deleting consensus metadata
Aug 06 10:45:50 dist-test-slave-fgb3 krb5kdc[9563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:45:50.177237 9607 catalog_manager.cc:4841] TS b1d59f74d3f2436f9f1caa78d27e3611 (127.16.45.66:37543): tablet 13ea96ac8fa145eb9e205200e36d495d (table test-table [id=60341385fe7d4994b7d75b4001687303]) successfully deleted
I20260806 10:45:50.184147 10287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:50.153961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43104 (local address 127.16.45.65:39963)
0806 10:45:50.154125 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:50.154131 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:50.165575 (+ 11444us) server_negotiation.cc:407] Connection header received
0806 10:45:50.165827 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:50.165834 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:50.165930 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:50.166024 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:50.167808 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.168904 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.170804 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.171403 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.171531 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:50.176906 (+ 5375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:50.176928 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:50.176949 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:50.176997 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:50.180799 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:50.181664 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:50.181673 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:50.181677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:50.181863 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:50.182288 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:50.182293 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:50.182296 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:50.182851 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:50.183165 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:50.183498 (+ 333us) server_negotiation.cc:299] Negotiation successful
0806 10:45:50.183732 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 10:45:50.185048 9888 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:50.293397 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 9714
I20260806 10:45:50.323230 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 9901
Aug 06 10:45:50 dist-test-slave-fgb3 krb5kdc[9563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:45:50.338780 10291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:50.324013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53196 (local address 127.16.45.66:37543)
0806 10:45:50.324202 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:50.324208 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:50.324300 (+ 92us) server_negotiation.cc:407] Connection header received
0806 10:45:50.324478 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:50.324484 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:50.324560 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:50.324646 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:50.325963 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.326754 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.328021 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.328423 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.328534 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:50.332783 (+ 4249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:50.332801 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:50.332817 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:50.332853 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:50.335832 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:50.336510 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:50.336517 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:50.336520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:50.336646 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:50.337027 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:50.337031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:50.337033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:50.337417 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:50.337704 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:50.338035 (+ 331us) server_negotiation.cc:299] Negotiation successful
0806 10:45:50.338256 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 10:45:50.339437 10073 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:50.428056 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 9901
I20260806 10:45:50.457340 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 10091
Aug 06 10:45:50 dist-test-slave-fgb3 krb5kdc[9563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:45:50.475724 10290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:50.458219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57886 (local address 127.16.45.67:44845)
0806 10:45:50.458457 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:50.458462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:50.458485 (+ 23us) server_negotiation.cc:407] Connection header received
0806 10:45:50.458687 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:50.458691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:50.458763 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:50.458844 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:50.460737 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.461557 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.463675 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:50.464125 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:50.464216 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:50.469691 (+ 5475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:50.469706 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:50.469722 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:50.469756 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:50.472745 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:50.473562 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:50.473569 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:50.473571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:50.473737 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:50.474155 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:50.474158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:50.474160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:50.474596 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:50.474841 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:50.475212 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 10:45:50.475399 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260806 10:45:50.476398 10259 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:50.600347 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 10091
I20260806 10:45:50.625388 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 9584
I20260806 10:45:50.626700 9667 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:50.737033 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 9584
2026-08-06T10:45:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4509 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T10:45:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:45:50Z Disabled control of system clock
I20260806 10:45:50.831270 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:44729
--webserver_interface=127.16.45.126
--webserver_port=0
--builtin_ntp_servers=127.16.45.84:43173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:44729
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 10:45:51.165656 10341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:51.165962 10341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:51.166072 10341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:51.173301 10341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:45:51.173413 10341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:51.173453 10341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:51.173532 10341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:45:51.173590 10341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:45:51.182852 10341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:43173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:44729
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:44729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:51.184127 10341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:51.185887 10341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:51.197899 10348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:51.197845 10350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:51.197868 10353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:51.199684 10341 server_base.cc:1034] running on GCE node
I20260806 10:45:51.200675 10341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:51.202150 10341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:51.203389 10341 hybrid_clock.cc:648] HybridClock initialized: now 1786013151203321 us; error 60 us; skew 500 ppm
I20260806 10:45:51.203778 10341 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:45:51.209209 10341 webserver.cc:460] Webserver started at http://127.16.45.126:44917/ using document root <none> and password file <none>
I20260806 10:45:51.210012 10341 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:51.210117 10341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:51.210507 10341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:51.213554 10341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "6f1d2e14ebb24f3a8b72697e37373a5b"
format_stamp: "Formatted at 2026-08-06 10:45:51 on dist-test-slave-fgb3"
server_key: "7ca3eb590f4677f623864df5def9dc79"
server_key_iv: "af30e1f96bce2e82e036a219b2490eb4"
server_key_version: "encryptionkey@0"
I20260806 10:45:51.214422 10341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "6f1d2e14ebb24f3a8b72697e37373a5b"
format_stamp: "Formatted at 2026-08-06 10:45:51 on dist-test-slave-fgb3"
server_key: "7ca3eb590f4677f623864df5def9dc79"
server_key_iv: "af30e1f96bce2e82e036a219b2490eb4"
server_key_version: "encryptionkey@0"
I20260806 10:45:51.219832 10341 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 10:45:51.223382 10363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:51.224771 10341 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 10:45:51.224992 10341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "6f1d2e14ebb24f3a8b72697e37373a5b"
format_stamp: "Formatted at 2026-08-06 10:45:51 on dist-test-slave-fgb3"
server_key: "7ca3eb590f4677f623864df5def9dc79"
server_key_iv: "af30e1f96bce2e82e036a219b2490eb4"
server_key_version: "encryptionkey@0"
I20260806 10:45:51.225194 10341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:51.248845 10341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:51.249732 10341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:51.250015 10341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:51.267968 10341 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:44729
I20260806 10:45:51.267990 10438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:44729 every 8 connection(s)
I20260806 10:45:51.269240 10341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:45:51.272985 10439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:51.279011 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 10341
I20260806 10:45:51.279186 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:45:51.279619 16565 external_mini_cluster.cc:1428] Setting key 5689c173256c5ddc09ac67dff4d3f653
I20260806 10:45:51.284556 10439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b: Bootstrap starting.
I20260806 10:45:51.288733 10439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:51.289970 10439 log.cc:824] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:51.293459 10439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b: No bootstrap required, opened a new log
I20260806 10:45:51.296214 10442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:51.282169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39994 (local address 127.16.45.126:44729)
0806 10:45:51.283492 (+ 1323us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:51.283507 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:51.283557 (+ 50us) server_negotiation.cc:407] Connection header received
0806 10:45:51.285938 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:51.285967 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:51.286651 (+ 684us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:51.287117 (+ 466us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:51.287662 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:51.289606 (+ 1944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:51.291396 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:51.292417 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:51.292622 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:51.293785 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:51.293795 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:51.293808 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:45:51.294460 (+ 652us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:51.294546 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:45:51.294569 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:51.294681 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:51.294927 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 10:45:51.295233 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":773,"thread_start_us":367,"threads_started":1}
I20260806 10:45:51.301365 10439 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1d2e14ebb24f3a8b72697e37373a5b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44729 } }
I20260806 10:45:51.301844 10439 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:51.301954 10439 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f1d2e14ebb24f3a8b72697e37373a5b, State: Initialized, Role: FOLLOWER
I20260806 10:45:51.302623 10439 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1d2e14ebb24f3a8b72697e37373a5b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44729 } }
I20260806 10:45:51.302857 10439 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:45:51.302984 10439 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:45:51.303138 10439 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:51.305322 10439 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1d2e14ebb24f3a8b72697e37373a5b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44729 } }
I20260806 10:45:51.305836 10439 leader_election.cc:302] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f1d2e14ebb24f3a8b72697e37373a5b; no voters:
I20260806 10:45:51.306471 10439 leader_election.cc:288] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:45:51.306612 10446 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:45:51.307256 10446 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [term 1 LEADER]: Becoming Leader. State: Replica: 6f1d2e14ebb24f3a8b72697e37373a5b, State: Running, Role: LEADER
I20260806 10:45:51.307737 10446 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1d2e14ebb24f3a8b72697e37373a5b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44729 } }
I20260806 10:45:51.308482 10439 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:45:51.310377 10448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f1d2e14ebb24f3a8b72697e37373a5b. Latest consensus state: current_term: 1 leader_uuid: "6f1d2e14ebb24f3a8b72697e37373a5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1d2e14ebb24f3a8b72697e37373a5b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44729 } } }
I20260806 10:45:51.310856 10448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [sys.catalog]: This master's current role is: LEADER
I20260806 10:45:51.310380 10447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f1d2e14ebb24f3a8b72697e37373a5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1d2e14ebb24f3a8b72697e37373a5b" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44729 } } }
I20260806 10:45:51.315575 10447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b [sys.catalog]: This master's current role is: LEADER
I20260806 10:45:51.317253 10452 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:45:51.323333 10452 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:45:51.332713 10452 catalog_manager.cc:1347] Generated new cluster ID: 5c700df9e2ff41ad9e25b3be1cd34137
I20260806 10:45:51.332839 10452 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:45:51.344622 10452 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:45:51.346048 10452 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:45:51.352986 10452 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b: Generated new TSK 0
I20260806 10:45:51.353856 10452 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:45:51.363493 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44729
--builtin_ntp_servers=127.16.45.84:43173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 10:45:51.723964 10472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:51.724252 10472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:51.724377 10472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:51.731827 10472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:51.731940 10472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:51.732081 10472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:45:51.741096 10472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:43173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44729
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:51.742419 10472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:51.744158 10472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:51.757175 10486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:51.757218 10482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:51.757238 10483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:51.757889 10472 server_base.cc:1034] running on GCE node
I20260806 10:45:51.758545 10472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:51.759511 10472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:51.760713 10472 hybrid_clock.cc:648] HybridClock initialized: now 1786013151760659 us; error 44 us; skew 500 ppm
I20260806 10:45:51.761036 10472 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:45:51.763415 10472 webserver.cc:460] Webserver started at http://127.16.45.65:44995/ using document root <none> and password file <none>
I20260806 10:45:51.764107 10472 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:51.764200 10472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:51.764519 10472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:51.767455 10472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "1cfdd06618c54d6c8ebaa7526a88a00a"
format_stamp: "Formatted at 2026-08-06 10:45:51 on dist-test-slave-fgb3"
server_key: "96bca2862f20c1b9047485ca9d88c532"
server_key_iv: "66c074069b6ed435321677138320afce"
server_key_version: "encryptionkey@0"
I20260806 10:45:51.768229 10472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "1cfdd06618c54d6c8ebaa7526a88a00a"
format_stamp: "Formatted at 2026-08-06 10:45:51 on dist-test-slave-fgb3"
server_key: "96bca2862f20c1b9047485ca9d88c532"
server_key_iv: "66c074069b6ed435321677138320afce"
server_key_version: "encryptionkey@0"
I20260806 10:45:51.773429 10472 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:45:51.776986 10493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:51.778343 10472 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:45:51.778517 10472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "1cfdd06618c54d6c8ebaa7526a88a00a"
format_stamp: "Formatted at 2026-08-06 10:45:51 on dist-test-slave-fgb3"
server_key: "96bca2862f20c1b9047485ca9d88c532"
server_key_iv: "66c074069b6ed435321677138320afce"
server_key_version: "encryptionkey@0"
I20260806 10:45:51.778720 10472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:51.806412 10472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:51.807257 10472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:51.807541 10472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:51.808459 10472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:51.809957 10472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:51.810045 10472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:51.810153 10472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:51.810225 10472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:51.839402 10472 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:38951
I20260806 10:45:51.839529 10663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:38951 every 8 connection(s)
I20260806 10:45:51.840790 10472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:45:51.850616 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 10472
I20260806 10:45:51.850807 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:45:51.851361 16565 external_mini_cluster.cc:1428] Setting key bc9688ac050aeb932e5eafe0b7a2ef18
I20260806 10:45:51.853753 10668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:51.843486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:41831 (local address 127.16.45.126:44729)
0806 10:45:51.843951 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:51.843955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:51.845133 (+ 1178us) server_negotiation.cc:407] Connection header received
0806 10:45:51.846925 (+ 1792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:51.846929 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:51.846998 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:51.847095 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:51.848256 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:51.848992 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:51.850686 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:51.851279 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:51.851413 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:51.852826 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:51.852833 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:51.852838 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:45:51.852859 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:51.852924 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:45:51.852941 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:51.853054 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:51.853375 (+ 321us) server_negotiation.cc:299] Negotiation successful
0806 10:45:51.853477 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":239,"threads_started":1}
I20260806 10:45:51.854784 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44729
--builtin_ntp_servers=127.16.45.84:43173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 10:45:51.855216 10669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:51.844090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:44729 (local address 127.16.45.65:41831)
0806 10:45:51.844984 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:51.845018 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:51.846684 (+ 1666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:51.847283 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:51.847292 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:51.847406 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:51.848076 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:51.848109 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:51.849161 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:51.849170 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:51.850541 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:51.850555 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:51.851552 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:51.851560 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:51.851810 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:51.852526 (+ 716us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:45:51.852529 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:51.852577 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:45:51.852657 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:51.853042 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:51.853055 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:51.853064 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 10:45:51.853358 (+ 294us) client_negotiation.cc:240] Negotiation successful
0806 10:45:51.853747 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":276,"threads_started":1}
I20260806 10:45:51.856726 10664 heartbeater.cc:347] Connected to a master server at 127.16.45.126:44729
I20260806 10:45:51.857045 10664 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:51.857954 10664 heartbeater.cc:511] Master 127.16.45.126:44729 requested a full tablet report, sending...
I20260806 10:45:51.860144 10385 ts_manager.cc:194] Registered new tserver with Master: 1cfdd06618c54d6c8ebaa7526a88a00a (127.16.45.65:38951)
I20260806 10:45:51.861642 10385 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.45.65:41831
W20260806 10:45:52.183779 10670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:52.184060 10670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:52.184170 10670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:52.191360 10670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:52.191462 10670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:52.191599 10670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:45:52.200510 10670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:43173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44729
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:52.201781 10670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:52.203536 10670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:52.216528 10676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:52.216503 10677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:52.216459 10679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:52.217316 10670 server_base.cc:1034] running on GCE node
I20260806 10:45:52.217953 10670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:52.219018 10670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:52.220235 10670 hybrid_clock.cc:648] HybridClock initialized: now 1786013152220184 us; error 35 us; skew 500 ppm
I20260806 10:45:52.220577 10670 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:45:52.222927 10670 webserver.cc:460] Webserver started at http://127.16.45.66:38659/ using document root <none> and password file <none>
I20260806 10:45:52.223626 10670 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:52.223734 10670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:52.224056 10670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:52.227075 10670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "d0a72235fadf400ebf5f4f1e949c944d"
format_stamp: "Formatted at 2026-08-06 10:45:52 on dist-test-slave-fgb3"
server_key: "7c170660349c91fd06cf7b965b00ca8d"
server_key_iv: "441e61792e57283435e9339cc9d1d563"
server_key_version: "encryptionkey@0"
I20260806 10:45:52.227878 10670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "d0a72235fadf400ebf5f4f1e949c944d"
format_stamp: "Formatted at 2026-08-06 10:45:52 on dist-test-slave-fgb3"
server_key: "7c170660349c91fd06cf7b965b00ca8d"
server_key_iv: "441e61792e57283435e9339cc9d1d563"
server_key_version: "encryptionkey@0"
I20260806 10:45:52.233269 10670 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:45:52.236825 10688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:52.238191 10670 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:45:52.238411 10670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "d0a72235fadf400ebf5f4f1e949c944d"
format_stamp: "Formatted at 2026-08-06 10:45:52 on dist-test-slave-fgb3"
server_key: "7c170660349c91fd06cf7b965b00ca8d"
server_key_iv: "441e61792e57283435e9339cc9d1d563"
server_key_version: "encryptionkey@0"
I20260806 10:45:52.238626 10670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:52.254135 10670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:52.254985 10670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:52.255271 10670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:52.256233 10670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:52.257732 10670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:52.257836 10670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:52.257946 10670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:52.258036 10670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:52.288822 10670 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:43127
I20260806 10:45:52.288861 10857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:43127 every 8 connection(s)
I20260806 10:45:52.290480 10670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:45:52.295500 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 10670
I20260806 10:45:52.295675 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:45:52.296094 16565 external_mini_cluster.cc:1428] Setting key 563d2c4a1eb6bbd72ce551bc712ae0a7
I20260806 10:45:52.299356 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44729
--builtin_ntp_servers=127.16.45.84:43173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 10:45:52.303548 10668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:52.293053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:59149 (local address 127.16.45.126:44729)
0806 10:45:52.293273 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:52.293280 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:52.294699 (+ 1419us) server_negotiation.cc:407] Connection header received
0806 10:45:52.296521 (+ 1822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:52.296528 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:52.296618 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:52.296722 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:52.298039 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.299061 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.300787 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.301317 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.301433 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:52.302833 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:52.302839 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:52.302843 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:45:52.302865 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:52.302902 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:45:52.302917 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:52.302999 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:52.303179 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 10:45:52.303273 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 10:45:52.304538 10860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:52.293612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:44729 (local address 127.16.45.66:59149)
0806 10:45:52.294548 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:52.294590 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:52.296266 (+ 1676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:52.296967 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:52.296976 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:52.297080 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:52.297866 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:52.297889 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.299243 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.299247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:52.300606 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:52.300619 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.301561 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.301566 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:52.301771 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:52.302519 (+ 748us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:45:52.302522 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:52.302564 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:45:52.302644 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:52.302998 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:52.303004 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:52.303010 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 10:45:52.303151 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 10:45:52.303483 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":273,"threads_started":1}
I20260806 10:45:52.305891 10858 heartbeater.cc:347] Connected to a master server at 127.16.45.126:44729
I20260806 10:45:52.306221 10858 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:52.307169 10858 heartbeater.cc:511] Master 127.16.45.126:44729 requested a full tablet report, sending...
I20260806 10:45:52.308708 10385 ts_manager.cc:194] Registered new tserver with Master: d0a72235fadf400ebf5f4f1e949c944d (127.16.45.66:43127)
I20260806 10:45:52.309592 10385 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.45.66:59149
W20260806 10:45:52.631484 10861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:52.631784 10861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:52.631914 10861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:52.639298 10861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:52.639412 10861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:52.639555 10861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:45:52.648902 10861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:43173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:44729
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:52.650202 10861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:52.652004 10861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:52.664978 10868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:52.664935 10869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:52.665025 10871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:52.665323 10861 server_base.cc:1034] running on GCE node
I20260806 10:45:52.666180 10861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:52.667219 10861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:52.668427 10861 hybrid_clock.cc:648] HybridClock initialized: now 1786013152668366 us; error 49 us; skew 500 ppm
I20260806 10:45:52.668782 10861 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:45:52.671100 10861 webserver.cc:460] Webserver started at http://127.16.45.67:46447/ using document root <none> and password file <none>
I20260806 10:45:52.671784 10861 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:52.671876 10861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:52.672155 10861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:52.675127 10861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "509b792e27674efe9fd3361d980b1fd3"
format_stamp: "Formatted at 2026-08-06 10:45:52 on dist-test-slave-fgb3"
server_key: "42941b61ab72e0ec62493f6bc83dd461"
server_key_iv: "ffe900cb25386407526fbc08629454f2"
server_key_version: "encryptionkey@0"
I20260806 10:45:52.675889 10861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "509b792e27674efe9fd3361d980b1fd3"
format_stamp: "Formatted at 2026-08-06 10:45:52 on dist-test-slave-fgb3"
server_key: "42941b61ab72e0ec62493f6bc83dd461"
server_key_iv: "ffe900cb25386407526fbc08629454f2"
server_key_version: "encryptionkey@0"
I20260806 10:45:52.681073 10861 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260806 10:45:52.684739 10881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:52.686384 10861 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 10:45:52.686543 10861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "509b792e27674efe9fd3361d980b1fd3"
format_stamp: "Formatted at 2026-08-06 10:45:52 on dist-test-slave-fgb3"
server_key: "42941b61ab72e0ec62493f6bc83dd461"
server_key_iv: "ffe900cb25386407526fbc08629454f2"
server_key_version: "encryptionkey@0"
I20260806 10:45:52.686774 10861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:52.719336 10861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:52.720275 10861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:52.720575 10861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:52.721655 10861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:52.723275 10861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:52.723369 10861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:52.723482 10861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:52.723552 10861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:52.754976 10861 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:38059
I20260806 10:45:52.755102 11037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:38059 every 8 connection(s)
I20260806 10:45:52.756269 10861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:45:52.760528 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 10861
I20260806 10:45:52.760677 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:45:52.761116 16565 external_mini_cluster.cc:1428] Setting key 68be314b8158cac648631541e217fe4b
I20260806 10:45:52.768394 10668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:52.758725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:58955 (local address 127.16.45.126:44729)
0806 10:45:52.758947 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:52.758953 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:52.760303 (+ 1350us) server_negotiation.cc:407] Connection header received
0806 10:45:52.762250 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:52.762255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:52.762392 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:52.762496 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:52.763769 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.764577 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.766040 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.766469 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.766559 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:52.767761 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:52.767766 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:52.767769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:45:52.767786 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:52.767817 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:45:52.767828 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:52.767894 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:52.768070 (+ 176us) server_negotiation.cc:299] Negotiation successful
0806 10:45:52.768141 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 10:45:52.769367 11040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:52.759270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:44729 (local address 127.16.45.67:58955)
0806 10:45:52.760135 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:52.760171 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:52.761968 (+ 1797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:52.762697 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:52.762708 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:52.762820 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:52.763602 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:52.763628 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.764717 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.764721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:52.765921 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:52.765938 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.766643 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.766648 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:52.766843 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:52.767472 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:45:52.767475 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:52.767513 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:45:52.767585 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:52.767902 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:52.767909 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:52.767914 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 10:45:52.768053 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 10:45:52.768366 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":255,"threads_started":1}
I20260806 10:45:52.770710 11038 heartbeater.cc:347] Connected to a master server at 127.16.45.126:44729
I20260806 10:45:52.770977 11038 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:52.771687 11038 heartbeater.cc:511] Master 127.16.45.126:44729 requested a full tablet report, sending...
I20260806 10:45:52.773041 10385 ts_manager.cc:194] Registered new tserver with Master: 509b792e27674efe9fd3361d980b1fd3 (127.16.45.67:38059)
I20260806 10:45:52.773836 10385 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.45.67:58955
I20260806 10:45:52.776400 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:45:52.786509 10668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:52.780344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40006 (local address 127.16.45.126:44729)
0806 10:45:52.780583 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:52.780590 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:52.780936 (+ 346us) server_negotiation.cc:407] Connection header received
0806 10:45:52.781072 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:52.781076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:52.781147 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:52.781225 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:52.781708 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.782515 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.784021 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.784674 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.784803 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:52.785893 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:52.785898 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:52.785901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:45:52.785918 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:52.785951 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:45:52.785963 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:52.786031 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:52.786115 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 10:45:52.786187 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:45:52.790444 10385 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40006:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:45:52.797341 10385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:45:52.820061 11060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:52.811533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38951 (local address 127.0.0.1:49948)
0806 10:45:52.812619 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:52.812644 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:52.812761 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:52.813638 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:52.813643 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:52.813671 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:52.814067 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:52.814075 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.815376 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.815379 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:52.817547 (+ 2168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:52.817560 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.819068 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.819075 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:52.819293 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:52.819349 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 10:45:52.819480 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 10:45:52.819674 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":960,"mutex_wait_us":79,"thread_start_us":806,"threads_started":1}
I20260806 10:45:52.821043 11061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:52.812088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49948 (local address 127.16.45.65:38951)
0806 10:45:52.813200 (+ 1112us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:52.813208 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:52.813233 (+ 25us) server_negotiation.cc:407] Connection header received
0806 10:45:52.813312 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:52.813317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:52.813449 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:52.813638 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:52.814218 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.815235 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.817738 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.818852 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.818997 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:52.819273 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:52.819566 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 10:45:52.819741 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":989,"thread_start_us":896,"threads_started":1}
I20260806 10:45:52.821552 11055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:52.809156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:38059 (local address 127.0.0.1:55602)
0806 10:45:52.810889 (+ 1733us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:52.810942 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:52.811130 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:52.813184 (+ 2054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:52.813191 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:52.813221 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:52.813823 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:52.813842 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.815782 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.815787 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:52.818425 (+ 2638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:52.818441 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.820513 (+ 2072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.820519 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:52.820939 (+ 420us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:52.820989 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 10:45:52.821083 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 10:45:52.821217 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1495,"mutex_wait_us":141,"thread_start_us":2751,"threads_started":1}
I20260806 10:45:52.821676 11056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:52.809503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55602 (local address 127.16.45.67:38059)
0806 10:45:52.810505 (+ 1002us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:52.810513 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:52.811340 (+ 827us) server_negotiation.cc:407] Connection header received
0806 10:45:52.811444 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:52.811452 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:52.811700 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:52.811873 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:52.814057 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.815626 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.818655 (+ 3029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.820132 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.820255 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:52.820911 (+ 656us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:52.821139 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 10:45:52.821312 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":830,"thread_start_us":661,"threads_started":1}
I20260806 10:45:52.821796 11059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:52.809804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45394 (local address 127.16.45.66:43127)
0806 10:45:52.811442 (+ 1638us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:52.811449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:52.812307 (+ 858us) server_negotiation.cc:407] Connection header received
0806 10:45:52.812618 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:52.812625 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:52.812852 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:52.813006 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:52.813967 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.815613 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.818678 (+ 3065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.820110 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.820573 (+ 463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:52.820765 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:52.821310 (+ 545us) server_negotiation.cc:299] Negotiation successful
0806 10:45:52.821471 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1488,"thread_start_us":2262,"threads_started":1}
I20260806 10:45:52.822448 11053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:52.809301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:43127 (local address 127.0.0.1:45394)
0806 10:45:52.812192 (+ 2891us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:52.812215 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:52.812425 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:52.813274 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:52.813278 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:52.813324 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:52.813738 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:52.813752 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.815790 (+ 2038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.815794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:52.818428 (+ 2634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:52.818441 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:52.820890 (+ 2449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:52.820896 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:52.821097 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:52.821133 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 10:45:52.821985 (+ 852us) client_negotiation.cc:240] Negotiation successful
0806 10:45:52.822092 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2764,"mutex_wait_us":247,"spinlock_wait_cycles":10624,"thread_start_us":1217,"threads_started":1}
I20260806 10:45:52.824930 10566 tablet_service.cc:1467] Processing CreateTablet for tablet 9b33c2cc7f344d3d9db4bffe1b0ca804 (DEFAULT_TABLE table=test-table [id=5abdd4390dba4a05a7f748b6bd56b308]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:45:52.825613 10944 tablet_service.cc:1467] Processing CreateTablet for tablet 9b33c2cc7f344d3d9db4bffe1b0ca804 (DEFAULT_TABLE table=test-table [id=5abdd4390dba4a05a7f748b6bd56b308]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:45:52.825798 10760 tablet_service.cc:1467] Processing CreateTablet for tablet 9b33c2cc7f344d3d9db4bffe1b0ca804 (DEFAULT_TABLE table=test-table [id=5abdd4390dba4a05a7f748b6bd56b308]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:45:52.826462 10566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b33c2cc7f344d3d9db4bffe1b0ca804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:52.827215 10944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b33c2cc7f344d3d9db4bffe1b0ca804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:52.827265 10760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b33c2cc7f344d3d9db4bffe1b0ca804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:52.837809 11062 tablet_bootstrap.cc:492] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a: Bootstrap starting.
I20260806 10:45:52.842058 11065 tablet_bootstrap.cc:492] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3: Bootstrap starting.
I20260806 10:45:52.845674 11065 tablet_bootstrap.cc:654] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:52.846987 11065 log.cc:824] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:52.847787 11067 tablet_bootstrap.cc:492] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d: Bootstrap starting.
I20260806 10:45:52.849629 11062 tablet_bootstrap.cc:654] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:52.851095 11062 log.cc:824] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:52.851256 11067 tablet_bootstrap.cc:654] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:52.852512 11067 log.cc:824] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:52.855695 11067 tablet_bootstrap.cc:492] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d: No bootstrap required, opened a new log
I20260806 10:45:52.855926 11062 tablet_bootstrap.cc:492] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a: No bootstrap required, opened a new log
I20260806 10:45:52.855990 11067 ts_tablet_manager.cc:1397] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 10:45:52.856200 11065 tablet_bootstrap.cc:492] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3: No bootstrap required, opened a new log
I20260806 10:45:52.856204 11062 ts_tablet_manager.cc:1397] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.000s
I20260806 10:45:52.856473 11065 ts_tablet_manager.cc:1397] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.000s
I20260806 10:45:52.864434 11067 raft_consensus.cc:348] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509b792e27674efe9fd3361d980b1fd3" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 38059 } } peers { permanent_uuid: "d0a72235fadf400ebf5f4f1e949c944d" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43127 } } peers { permanent_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38951 } }
I20260806 10:45:52.864838 11067 raft_consensus.cc:374] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:52.864964 11067 raft_consensus.cc:729] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0a72235fadf400ebf5f4f1e949c944d, State: Initialized, Role: FOLLOWER
I20260806 10:45:52.865072 10664 heartbeater.cc:503] Master 127.16.45.126:44729 was elected leader, sending a full tablet report...
I20260806 10:45:52.865641 11067 consensus_queue.cc:260] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509b792e27674efe9fd3361d980b1fd3" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 38059 } } peers { permanent_uuid: "d0a72235fadf400ebf5f4f1e949c944d" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43127 } } peers { permanent_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38951 } }
I20260806 10:45:52.866652 11065 raft_consensus.cc:348] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509b792e27674efe9fd3361d980b1fd3" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 38059 } } peers { permanent_uuid: "d0a72235fadf400ebf5f4f1e949c944d" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43127 } } peers { permanent_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38951 } }
I20260806 10:45:52.867172 11065 raft_consensus.cc:374] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:52.867314 11065 raft_consensus.cc:729] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509b792e27674efe9fd3361d980b1fd3, State: Initialized, Role: FOLLOWER
I20260806 10:45:52.868019 11065 consensus_queue.cc:260] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509b792e27674efe9fd3361d980b1fd3" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 38059 } } peers { permanent_uuid: "d0a72235fadf400ebf5f4f1e949c944d" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43127 } } peers { permanent_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38951 } }
I20260806 10:45:52.868168 11062 raft_consensus.cc:348] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509b792e27674efe9fd3361d980b1fd3" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 38059 } } peers { permanent_uuid: "d0a72235fadf400ebf5f4f1e949c944d" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43127 } } peers { permanent_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38951 } }
I20260806 10:45:52.868752 11062 raft_consensus.cc:374] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:52.868901 11062 raft_consensus.cc:729] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cfdd06618c54d6c8ebaa7526a88a00a, State: Initialized, Role: FOLLOWER
I20260806 10:45:52.869606 11062 consensus_queue.cc:260] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509b792e27674efe9fd3361d980b1fd3" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 38059 } } peers { permanent_uuid: "d0a72235fadf400ebf5f4f1e949c944d" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43127 } } peers { permanent_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38951 } }
I20260806 10:45:52.870874 11038 heartbeater.cc:503] Master 127.16.45.126:44729 was elected leader, sending a full tablet report...
I20260806 10:45:52.871610 11065 ts_tablet_manager.cc:1428] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260806 10:45:52.872852 10858 heartbeater.cc:503] Master 127.16.45.126:44729 was elected leader, sending a full tablet report...
I20260806 10:45:52.873544 11067 ts_tablet_manager.cc:1428] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d: Time spent starting tablet: real 0.017s user 0.014s sys 0.004s
I20260806 10:45:52.875022 11062 ts_tablet_manager.cc:1428] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a: Time spent starting tablet: real 0.019s user 0.010s sys 0.007s
W20260806 10:45:53.007903 11039 tablet.cc:2369] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:45:53.042707 10859 tablet.cc:2369] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:45:53.093228 10666 tablet.cc:2369] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:45:53.127708 11072 raft_consensus.cc:482] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:45:53.128080 11072 raft_consensus.cc:504] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509b792e27674efe9fd3361d980b1fd3" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 38059 } } peers { permanent_uuid: "d0a72235fadf400ebf5f4f1e949c944d" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43127 } } peers { permanent_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38951 } }
I20260806 10:45:53.130045 11072 leader_election.cc:288] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 509b792e27674efe9fd3361d980b1fd3 (127.16.45.67:38059), 1cfdd06618c54d6c8ebaa7526a88a00a (127.16.45.65:38951)
I20260806 10:45:53.136873 11056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:53.130541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:33021 (local address 127.16.45.67:38059)
0806 10:45:53.130767 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:53.130773 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:53.131319 (+ 546us) server_negotiation.cc:407] Connection header received
0806 10:45:53.131523 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:53.131529 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:53.131609 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:53.131697 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:53.132382 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.133130 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.135223 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.136015 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.136172 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:53.136240 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:53.136518 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 10:45:53.136645 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260806 10:45:53.136889 11061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:53.130586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:40741 (local address 127.16.45.65:38951)
0806 10:45:53.130966 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:53.130971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:53.131555 (+ 584us) server_negotiation.cc:407] Connection header received
0806 10:45:53.131707 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:53.131712 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:53.131799 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:53.131898 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:53.132485 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.133175 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.135190 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.135965 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.136098 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:53.136171 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:53.136505 (+ 334us) server_negotiation.cc:299] Negotiation successful
0806 10:45:53.136636 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237}
I20260806 10:45:53.137004 11077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:53.130281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:38059 (local address 127.16.45.66:33021)
0806 10:45:53.131164 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:53.131187 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:53.131375 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:53.131731 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:53.131736 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:53.131762 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:53.132200 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:53.132210 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.133277 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.133282 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:53.135011 (+ 1729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:53.135024 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.136217 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.136222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:53.136356 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:53.136390 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 10:45:53.136472 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 10:45:53.136595 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"mutex_wait_us":112,"thread_start_us":453,"threads_started":1}
I20260806 10:45:53.137044 11078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:53.130495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:38951 (local address 127.16.45.66:40741)
0806 10:45:53.131441 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:53.131458 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:53.131589 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:53.131926 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:53.131929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:53.131948 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:53.132328 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:53.132341 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.133327 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.133333 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:53.135001 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:53.135014 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.136165 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.136172 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:53.136344 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:53.136378 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 10:45:53.136454 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 10:45:53.136578 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":829,"mutex_wait_us":94,"thread_start_us":631,"threads_started":1}
I20260806 10:45:53.138074 10600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b33c2cc7f344d3d9db4bffe1b0ca804" candidate_uuid: "d0a72235fadf400ebf5f4f1e949c944d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a" is_pre_election: true
I20260806 10:45:53.138075 10972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b33c2cc7f344d3d9db4bffe1b0ca804" candidate_uuid: "d0a72235fadf400ebf5f4f1e949c944d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509b792e27674efe9fd3361d980b1fd3" is_pre_election: true
I20260806 10:45:53.138577 10600 raft_consensus.cc:2454] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0a72235fadf400ebf5f4f1e949c944d in term 0.
I20260806 10:45:53.138577 10972 raft_consensus.cc:2454] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0a72235fadf400ebf5f4f1e949c944d in term 0.
I20260806 10:45:53.139201 10695 leader_election.cc:302] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509b792e27674efe9fd3361d980b1fd3, d0a72235fadf400ebf5f4f1e949c944d; no voters:
I20260806 10:45:53.139580 11072 raft_consensus.cc:2781] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:45:53.139703 11072 raft_consensus.cc:482] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:45:53.139796 11072 raft_consensus.cc:3037] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:53.141958 11072 raft_consensus.cc:504] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509b792e27674efe9fd3361d980b1fd3" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 38059 } } peers { permanent_uuid: "d0a72235fadf400ebf5f4f1e949c944d" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43127 } } peers { permanent_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38951 } }
I20260806 10:45:53.142633 11072 leader_election.cc:288] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [CANDIDATE]: Term 1 election: Requested vote from peers 509b792e27674efe9fd3361d980b1fd3 (127.16.45.67:38059), 1cfdd06618c54d6c8ebaa7526a88a00a (127.16.45.65:38951)
I20260806 10:45:53.143076 10600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b33c2cc7f344d3d9db4bffe1b0ca804" candidate_uuid: "d0a72235fadf400ebf5f4f1e949c944d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a"
I20260806 10:45:53.143095 10972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b33c2cc7f344d3d9db4bffe1b0ca804" candidate_uuid: "d0a72235fadf400ebf5f4f1e949c944d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509b792e27674efe9fd3361d980b1fd3"
I20260806 10:45:53.143252 10600 raft_consensus.cc:3037] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:53.143270 10972 raft_consensus.cc:3037] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:53.145409 10600 raft_consensus.cc:2454] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0a72235fadf400ebf5f4f1e949c944d in term 1.
I20260806 10:45:53.145417 10972 raft_consensus.cc:2454] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0a72235fadf400ebf5f4f1e949c944d in term 1.
I20260806 10:45:53.145792 10694 leader_election.cc:302] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cfdd06618c54d6c8ebaa7526a88a00a, d0a72235fadf400ebf5f4f1e949c944d; no voters:
I20260806 10:45:53.146070 11072 raft_consensus.cc:2781] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:45:53.146539 11072 raft_consensus.cc:686] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 1 LEADER]: Becoming Leader. State: Replica: d0a72235fadf400ebf5f4f1e949c944d, State: Running, Role: LEADER
I20260806 10:45:53.147001 11072 consensus_queue.cc:237] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509b792e27674efe9fd3361d980b1fd3" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 38059 } } peers { permanent_uuid: "d0a72235fadf400ebf5f4f1e949c944d" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43127 } } peers { permanent_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38951 } }
I20260806 10:45:53.151710 10385 catalog_manager.cc:5495] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d reported cstate change: term changed from 0 to 1, leader changed from <none> to d0a72235fadf400ebf5f4f1e949c944d (127.16.45.66). New cstate: current_term: 1 leader_uuid: "d0a72235fadf400ebf5f4f1e949c944d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509b792e27674efe9fd3361d980b1fd3" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 38059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0a72235fadf400ebf5f4f1e949c944d" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 43127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38951 } health_report { overall_health: UNKNOWN } } }
I20260806 10:45:53.191450 11059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:53.186109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45400 (local address 127.16.45.66:43127)
0806 10:45:53.186337 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:53.186344 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:53.186454 (+ 110us) server_negotiation.cc:407] Connection header received
0806 10:45:53.186706 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:53.186710 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:53.186840 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:53.186961 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:45:53.187317 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.188040 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.189401 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.189822 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.189931 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:53.190411 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:45:53.190949 (+ 538us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:45:53.191076 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:53.191156 (+ 80us) server_negotiation.cc:299] Negotiation successful
0806 10:45:53.191221 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 10:45:53.199527 10600 raft_consensus.cc:1261] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a [term 1 FOLLOWER]: Refusing update from remote peer d0a72235fadf400ebf5f4f1e949c944d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:45:53.199523 10972 raft_consensus.cc:1261] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3 [term 1 FOLLOWER]: Refusing update from remote peer d0a72235fadf400ebf5f4f1e949c944d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:45:53.200462 11079 consensus_queue.cc:1035] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [LEADER]: Connected to new peer: Peer: permanent_uuid: "509b792e27674efe9fd3361d980b1fd3" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 38059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:45:53.200778 11072 consensus_queue.cc:1035] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cfdd06618c54d6c8ebaa7526a88a00a" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 38951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:45:53.224994 10383 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:45:53.225251 10383 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:45:53.229120 10383 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f1d2e14ebb24f3a8b72697e37373a5b: Sending DeleteTablet for 3 replicas of tablet 9b33c2cc7f344d3d9db4bffe1b0ca804
I20260806 10:45:53.230334 10944 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b33c2cc7f344d3d9db4bffe1b0ca804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:45:53 UTC) from {username='slave'} at 127.0.0.1:55602
I20260806 10:45:53.230338 10760 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b33c2cc7f344d3d9db4bffe1b0ca804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:45:53 UTC) from {username='slave'} at 127.0.0.1:45394
I20260806 10:45:53.230360 10566 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b33c2cc7f344d3d9db4bffe1b0ca804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:45:53 UTC) from {username='slave'} at 127.0.0.1:49948
I20260806 10:45:53.231422 11100 tablet_replica.cc:330] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a: stopping tablet replica
I20260806 10:45:53.232604 11100 raft_consensus.cc:2229] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:45:53.232695 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 10472
I20260806 10:45:53.233136 11100 raft_consensus.cc:2258] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:45:53.235546 11100 ts_tablet_manager.cc:1905] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:45:53.242928 11097 tablet_replica.cc:330] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d: stopping tablet replica
I20260806 10:45:53.243425 11097 raft_consensus.cc:2229] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:45:53.244161 11097 raft_consensus.cc:2258] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:45:53.245712 11100 ts_tablet_manager.cc:1918] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:45:53.245918 11100 log.cc:1196] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/9b33c2cc7f344d3d9db4bffe1b0ca804
I20260806 10:45:53.246515 11100 ts_tablet_manager.cc:1939] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 1cfdd06618c54d6c8ebaa7526a88a00a: Deleting consensus metadata
I20260806 10:45:53.246949 11097 ts_tablet_manager.cc:1905] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:45:53.248643 10366 catalog_manager.cc:4841] TS 1cfdd06618c54d6c8ebaa7526a88a00a (127.16.45.65:38951): tablet 9b33c2cc7f344d3d9db4bffe1b0ca804 (table test-table [id=5abdd4390dba4a05a7f748b6bd56b308]) successfully deleted
I20260806 10:45:53.250829 11098 tablet_replica.cc:330] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3: stopping tablet replica
I20260806 10:45:53.251288 11098 raft_consensus.cc:2229] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:45:53.251754 11098 raft_consensus.cc:2258] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:45:53.254112 11098 ts_tablet_manager.cc:1905] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:45:53.254563 11097 ts_tablet_manager.cc:1918] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:45:53.254729 11097 log.cc:1196] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/9b33c2cc7f344d3d9db4bffe1b0ca804
I20260806 10:45:53.255321 11097 ts_tablet_manager.cc:1939] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P d0a72235fadf400ebf5f4f1e949c944d: Deleting consensus metadata
I20260806 10:45:53.257107 10364 catalog_manager.cc:4841] TS d0a72235fadf400ebf5f4f1e949c944d (127.16.45.66:43127): tablet 9b33c2cc7f344d3d9db4bffe1b0ca804 (table test-table [id=5abdd4390dba4a05a7f748b6bd56b308]) successfully deleted
I20260806 10:45:53.260393 11061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:53.234267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49952 (local address 127.16.45.65:38951)
0806 10:45:53.234483 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:53.234489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:53.250392 (+ 15903us) server_negotiation.cc:407] Connection header received
0806 10:45:53.252428 (+ 2036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:53.252434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:53.252547 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:53.252627 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:53.253364 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.254489 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.256404 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.257041 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.257137 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:53.258730 (+ 1593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:53.258741 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:53.258785 (+ 44us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:45:53.259559 (+ 774us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:53.259623 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:45:53.259649 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:53.259800 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:53.259930 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 10:45:53.260046 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260806 10:45:53.261121 10657 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:53.261178 11098 ts_tablet_manager.cc:1918] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:45:53.261356 11098 log.cc:1196] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/9b33c2cc7f344d3d9db4bffe1b0ca804
I20260806 10:45:53.261827 11098 ts_tablet_manager.cc:1939] T 9b33c2cc7f344d3d9db4bffe1b0ca804 P 509b792e27674efe9fd3361d980b1fd3: Deleting consensus metadata
I20260806 10:45:53.264657 10367 catalog_manager.cc:4841] TS 509b792e27674efe9fd3361d980b1fd3 (127.16.45.67:38059): tablet 9b33c2cc7f344d3d9db4bffe1b0ca804 (table test-table [id=5abdd4390dba4a05a7f748b6bd56b308]) successfully deleted
I20260806 10:45:53.364070 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 10472
I20260806 10:45:53.385183 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 10670
I20260806 10:45:53.392755 11059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:53.386082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45416 (local address 127.16.45.66:43127)
0806 10:45:53.386285 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:53.386291 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:53.386341 (+ 50us) server_negotiation.cc:407] Connection header received
0806 10:45:53.386485 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:53.386491 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:53.386583 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:53.386669 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:53.387083 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.387897 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.389145 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.389591 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.389701 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:53.390981 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:53.390995 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:53.391017 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:45:53.391888 (+ 871us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:53.391960 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:45:53.391988 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:53.392112 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:53.392216 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 10:45:53.392339 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 10:45:53.393551 10852 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:53.504581 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 10670
I20260806 10:45:53.526535 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 10861
I20260806 10:45:53.533349 11056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:53.527285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55610 (local address 127.16.45.67:38059)
0806 10:45:53.527513 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:53.527519 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:53.527575 (+ 56us) server_negotiation.cc:407] Connection header received
0806 10:45:53.527730 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:53.527735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:53.527825 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:53.527917 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:53.528271 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.529108 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.530495 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:53.530938 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:53.531050 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:53.531976 (+ 926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:53.531986 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:53.532001 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:45:53.532624 (+ 623us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:53.532674 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:45:53.532696 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:53.532795 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:53.532882 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 10:45:53.532976 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 10:45:53.534004 11031 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:53.620880 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 10861
I20260806 10:45:53.641763 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 10341
I20260806 10:45:53.642930 10433 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:53.752013 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 10341
2026-08-06T10:45:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3012 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:45:53 dist-test-slave-fgb3 krb5kdc[11110](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:45:53 dist-test-slave-fgb3 krb5kdc[11110](info): set up 2 sockets
Aug 06 10:45:53 dist-test-slave-fgb3 krb5kdc[11110](info): commencing operation
krb5kdc: starting...
W20260806 10:45:54.990885 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.004s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:45:55 dist-test-slave-fgb3 krb5kdc[11110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:45:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:45:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:45:55.298075 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:45203
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:45203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:45:55.633876 11127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:55.634184 11127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:55.634351 11127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:55.641649 11127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:45:55.641767 11127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:55.641849 11127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:55.641933 11127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:45:55.641992 11127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:45:55.651829 11127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:45203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:45203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:55.653107 11127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:55.654404 11127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:55.665459 11133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:55.665496 11134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:55.665532 11136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:55.666258 11127 server_base.cc:1034] running on GCE node
I20260806 10:45:55.667027 11127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:55.668354 11127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:55.669557 11127 hybrid_clock.cc:648] HybridClock initialized: now 1786013155669505 us; error 33 us; skew 500 ppm
I20260806 10:45:55.669893 11127 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:55 dist-test-slave-fgb3 krb5kdc[11110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013155, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:55.672904 11127 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:45:55.674265 11127 webserver.cc:460] Webserver started at http://127.16.45.126:39673/ using document root <none> and password file <none>
I20260806 10:45:55.674945 11127 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:55.675051 11127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:55.675328 11127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:55.678205 11127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "b3bb68505a3942eebf82cd25eeb18ff9"
format_stamp: "Formatted at 2026-08-06 10:45:55 on dist-test-slave-fgb3"
server_key: "9b802e005b24f433c8e4eaad1802bd28"
server_key_iv: "27ad27a436d00124539d64657f59db7a"
server_key_version: "encryptionkey@0"
I20260806 10:45:55.679014 11127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "b3bb68505a3942eebf82cd25eeb18ff9"
format_stamp: "Formatted at 2026-08-06 10:45:55 on dist-test-slave-fgb3"
server_key: "9b802e005b24f433c8e4eaad1802bd28"
server_key_iv: "27ad27a436d00124539d64657f59db7a"
server_key_version: "encryptionkey@0"
I20260806 10:45:55.683897 11127 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 10:45:55.687214 11144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:55.688469 11127 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 10:45:55.688637 11127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "b3bb68505a3942eebf82cd25eeb18ff9"
format_stamp: "Formatted at 2026-08-06 10:45:55 on dist-test-slave-fgb3"
server_key: "9b802e005b24f433c8e4eaad1802bd28"
server_key_iv: "27ad27a436d00124539d64657f59db7a"
server_key_version: "encryptionkey@0"
I20260806 10:45:55.688804 11127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:55.715276 11127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:55.719429 11127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:55.719712 11127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:55.737140 11127 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:45203
I20260806 10:45:55.737166 11218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:45203 every 8 connection(s)
I20260806 10:45:55.738499 11127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:45:55.739715 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 11127
I20260806 10:45:55.739913 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:45:55.740522 16565 external_mini_cluster.cc:1428] Setting key b1aa042a710ede19e2cec08732289702
I20260806 10:45:55.743176 11219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 10:45:55 dist-test-slave-fgb3 krb5kdc[11110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:45:55.756198 11219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9: Bootstrap starting.
I20260806 10:45:55.759559 11219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:55.760910 11219 log.cc:824] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:55.764060 11223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:55.742397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47592 (local address 127.16.45.126:45203)
0806 10:45:55.743192 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:55.743203 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:55.743251 (+ 48us) server_negotiation.cc:407] Connection header received
0806 10:45:55.744930 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:55.744951 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:55.745293 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:55.745623 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:55.747504 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:55.748878 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:55.750698 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:55.751413 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:55.751540 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:55.756487 (+ 4947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:55.756495 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:55.756512 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:55.756558 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:55.759667 (+ 3109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:55.760659 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:55.760666 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:55.760672 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:55.760838 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:55.761256 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:55.761259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:55.761261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:55.762025 (+ 764us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:55.762372 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:55.762707 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 10:45:55.763073 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":322,"threads_started":1}
I20260806 10:45:55.764241 11219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9: No bootstrap required, opened a new log
I20260806 10:45:55.771750 11219 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3bb68505a3942eebf82cd25eeb18ff9" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45203 } }
I20260806 10:45:55.772126 11219 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:55.772221 11219 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bb68505a3942eebf82cd25eeb18ff9, State: Initialized, Role: FOLLOWER
I20260806 10:45:55.772751 11219 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3bb68505a3942eebf82cd25eeb18ff9" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45203 } }
I20260806 10:45:55.772974 11219 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:45:55.773101 11219 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:45:55.773255 11219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:55.775745 11219 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3bb68505a3942eebf82cd25eeb18ff9" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45203 } }
I20260806 10:45:55.776235 11219 leader_election.cc:302] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3bb68505a3942eebf82cd25eeb18ff9; no voters:
I20260806 10:45:55.776844 11219 leader_election.cc:288] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:45:55.776984 11228 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:45:55.777629 11228 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [term 1 LEADER]: Becoming Leader. State: Replica: b3bb68505a3942eebf82cd25eeb18ff9, State: Running, Role: LEADER
I20260806 10:45:55.778232 11228 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3bb68505a3942eebf82cd25eeb18ff9" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45203 } }
I20260806 10:45:55.778904 11219 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:45:55.780767 11229 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3bb68505a3942eebf82cd25eeb18ff9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3bb68505a3942eebf82cd25eeb18ff9" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45203 } } }
I20260806 10:45:55.780882 11231 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3bb68505a3942eebf82cd25eeb18ff9. Latest consensus state: current_term: 1 leader_uuid: "b3bb68505a3942eebf82cd25eeb18ff9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3bb68505a3942eebf82cd25eeb18ff9" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45203 } } }
I20260806 10:45:55.781167 11229 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [sys.catalog]: This master's current role is: LEADER
I20260806 10:45:55.781167 11231 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9 [sys.catalog]: This master's current role is: LEADER
I20260806 10:45:55.784265 11239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:45:55.789388 11239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:45:55.798771 11239 catalog_manager.cc:1347] Generated new cluster ID: 78cdc8e3dc994751979fde33531d3f95
I20260806 10:45:55.798907 11239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:45:55.810982 11239 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:45:55.812288 11239 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:45:55.820951 11239 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9: Generated new TSK 0
I20260806 10:45:55.821870 11239 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:45:55.909381 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45203
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:45:56.248790 11255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:56.249079 11255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:56.249176 11255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:56.256313 11255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:56.256419 11255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:56.256533 11255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:45:56.266289 11255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:56.267521 11255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:56.268788 11255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:56.282054 11267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:56.282083 11265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:56.282434 11263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:56.282953 11255 server_base.cc:1034] running on GCE node
I20260806 10:45:56.283572 11255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:56.284626 11255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:56.285859 11255 hybrid_clock.cc:648] HybridClock initialized: now 1786013156285794 us; error 51 us; skew 500 ppm
I20260806 10:45:56.286194 11255 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:56 dist-test-slave-fgb3 krb5kdc[11110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013156, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:56.292412 11255 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:45:56.293927 11255 webserver.cc:460] Webserver started at http://127.16.45.65:41715/ using document root <none> and password file <none>
I20260806 10:45:56.294664 11255 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:56.294793 11255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:56.295090 11255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:56.297942 11255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "812e0742a59e482f942e79d99363d436"
format_stamp: "Formatted at 2026-08-06 10:45:56 on dist-test-slave-fgb3"
server_key: "5e9ed07406541f2f95a2da8e232777c2"
server_key_iv: "3d76e37a82286e06be7289dffb6ebc74"
server_key_version: "encryptionkey@0"
I20260806 10:45:56.298722 11255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "812e0742a59e482f942e79d99363d436"
format_stamp: "Formatted at 2026-08-06 10:45:56 on dist-test-slave-fgb3"
server_key: "5e9ed07406541f2f95a2da8e232777c2"
server_key_iv: "3d76e37a82286e06be7289dffb6ebc74"
server_key_version: "encryptionkey@0"
I20260806 10:45:56.303762 11255 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 10:45:56.307075 11276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:56.308355 11255 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:45:56.308516 11255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "812e0742a59e482f942e79d99363d436"
format_stamp: "Formatted at 2026-08-06 10:45:56 on dist-test-slave-fgb3"
server_key: "5e9ed07406541f2f95a2da8e232777c2"
server_key_iv: "3d76e37a82286e06be7289dffb6ebc74"
server_key_version: "encryptionkey@0"
I20260806 10:45:56.308707 11255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:56.337692 11255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:56.341645 11255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:56.341928 11255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:56.342974 11255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:56.344301 11255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:56.344381 11255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:56.344507 11255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:56.344575 11255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:56.375043 11255 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:34209
I20260806 10:45:56.375090 11434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:34209 every 8 connection(s)
I20260806 10:45:56.376341 11255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:45:56.383369 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 11255
I20260806 10:45:56.383548 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:45:56.384063 16565 external_mini_cluster.cc:1428] Setting key 74b4fa5e2c7e3505bf88f0a4090d5de8
Aug 06 10:45:56 dist-test-slave-fgb3 krb5kdc[11110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013156, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:45:56.397434 11438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:56.378893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:44617 (local address 127.16.45.126:45203)
0806 10:45:56.379344 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:56.379348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:56.380288 (+ 940us) server_negotiation.cc:407] Connection header received
0806 10:45:56.382108 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:56.382114 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:56.382205 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:56.382341 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:56.383982 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:56.384763 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:56.386826 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:56.387222 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:56.387317 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:56.391486 (+ 4169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:56.391490 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:56.391494 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:56.391527 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:56.394523 (+ 2996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:56.395222 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:56.395228 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:56.395231 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:56.395373 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:56.395751 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:56.395755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:56.395758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:56.396082 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:56.396216 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:56.396881 (+ 665us) server_negotiation.cc:299] Negotiation successful
0806 10:45:56.397097 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":228,"threads_started":1}
I20260806 10:45:56.398223 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:56.379425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:45203 (local address 127.16.45.65:44617)
0806 10:45:56.380138 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:56.380186 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:56.381824 (+ 1638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:56.382591 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:56.382604 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:56.383212 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:56.383819 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:56.383838 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:56.384970 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:56.384975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:56.386685 (+ 1710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:56.386701 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:56.387442 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:56.387449 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:56.387728 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:56.388425 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:45:56.388454 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:56.391250 (+ 2796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:56.394655 (+ 3405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:56.394662 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:56.394674 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:56.395098 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:56.395464 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:56.395467 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:56.395469 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:56.395651 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:56.396180 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:56.396185 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:56.396506 (+ 321us) client_negotiation.cc:769] Sending connection context
0806 10:45:56.396726 (+ 220us) client_negotiation.cc:240] Negotiation successful
0806 10:45:56.397120 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":292,"threads_started":1}
I20260806 10:45:56.399793 11436 heartbeater.cc:347] Connected to a master server at 127.16.45.126:45203
I20260806 10:45:56.400080 11436 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:56.400844 11436 heartbeater.cc:511] Master 127.16.45.126:45203 requested a full tablet report, sending...
I20260806 10:45:56.403232 11171 ts_manager.cc:194] Registered new tserver with Master: 812e0742a59e482f942e79d99363d436 (127.16.45.65:34209)
I20260806 10:45:56.405079 11171 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:44617
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:45:56.452879 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45203
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:45:56.776729 11443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:56.777037 11443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:56.777172 11443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:56.784476 11443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:56.784605 11443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:56.784782 11443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:45:56.794656 11443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:56.795944 11443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:56.797254 11443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:56.810516 11453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:56.810550 11450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:56.810571 11449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:56.811288 11443 server_base.cc:1034] running on GCE node
I20260806 10:45:56.811913 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:56.812951 11443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:56.814165 11443 hybrid_clock.cc:648] HybridClock initialized: now 1786013156814116 us; error 41 us; skew 500 ppm
I20260806 10:45:56.814587 11443 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:56 dist-test-slave-fgb3 krb5kdc[11110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013156, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:56.817740 11443 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:45:56.819301 11443 webserver.cc:460] Webserver started at http://127.16.45.66:34873/ using document root <none> and password file <none>
I20260806 10:45:56.820007 11443 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:56.820128 11443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:56.820441 11443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:56.823406 11443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "3a0735e9c47c41c99041f8a0d3baef77"
format_stamp: "Formatted at 2026-08-06 10:45:56 on dist-test-slave-fgb3"
server_key: "534136207481e72b3ad62a9bda685192"
server_key_iv: "38dc7f587f93696ea819c7437671f722"
server_key_version: "encryptionkey@0"
I20260806 10:45:56.824152 11443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "3a0735e9c47c41c99041f8a0d3baef77"
format_stamp: "Formatted at 2026-08-06 10:45:56 on dist-test-slave-fgb3"
server_key: "534136207481e72b3ad62a9bda685192"
server_key_iv: "38dc7f587f93696ea819c7437671f722"
server_key_version: "encryptionkey@0"
I20260806 10:45:56.829437 11443 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:45:56.832952 11462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:56.834347 11443 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 10:45:56.834514 11443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "3a0735e9c47c41c99041f8a0d3baef77"
format_stamp: "Formatted at 2026-08-06 10:45:56 on dist-test-slave-fgb3"
server_key: "534136207481e72b3ad62a9bda685192"
server_key_iv: "38dc7f587f93696ea819c7437671f722"
server_key_version: "encryptionkey@0"
I20260806 10:45:56.834707 11443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:56.847249 11443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:56.851128 11443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:56.851398 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:56.852310 11443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:56.853596 11443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:56.853672 11443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:56.853799 11443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:56.853854 11443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:56.883790 11443 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:40213
I20260806 10:45:56.883828 11617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:40213 every 8 connection(s)
I20260806 10:45:56.885092 11443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:45:56.891099 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 11443
I20260806 10:45:56.891319 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:45:56.891812 16565 external_mini_cluster.cc:1428] Setting key 796b1c0a5eabcd0110fc00b1f0427bb8
Aug 06 10:45:56 dist-test-slave-fgb3 krb5kdc[11110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013156, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:45:56.905665 11438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:56.887607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:57501 (local address 127.16.45.126:45203)
0806 10:45:56.887779 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:56.887783 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:56.888894 (+ 1111us) server_negotiation.cc:407] Connection header received
0806 10:45:56.890703 (+ 1809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:56.890732 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:56.890810 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:56.890898 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:56.892547 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:56.893431 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:56.895374 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:56.895993 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:56.896124 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:56.899537 (+ 3413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:56.899543 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:56.899547 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:56.899583 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:56.902469 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:56.903236 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:56.903297 (+ 61us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:56.903307 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:56.903493 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:56.903946 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:56.903950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:56.903953 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:56.904278 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:56.904419 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:56.905130 (+ 711us) server_negotiation.cc:299] Negotiation successful
0806 10:45:56.905350 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 10:45:56.906577 11620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:56.888058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:45203 (local address 127.16.45.66:57501)
0806 10:45:56.888736 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:56.888784 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:56.890447 (+ 1663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:56.891137 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:56.891145 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:56.891731 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:56.892329 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:56.892355 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:56.893613 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:56.893619 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:56.895223 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:56.895241 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:56.896182 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:56.896187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:56.896378 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:56.896995 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:45:56.897018 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:56.899309 (+ 2291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:56.902594 (+ 3285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:56.902602 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:56.902616 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:56.903110 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:56.903607 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:56.903611 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:56.903614 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:56.903825 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:56.904394 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:56.904401 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:56.904749 (+ 348us) client_negotiation.cc:769] Sending connection context
0806 10:45:56.905007 (+ 258us) client_negotiation.cc:240] Negotiation successful
0806 10:45:56.905450 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":269,"threads_started":1}
I20260806 10:45:56.908143 11618 heartbeater.cc:347] Connected to a master server at 127.16.45.126:45203
I20260806 10:45:56.908440 11618 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:56.909122 11618 heartbeater.cc:511] Master 127.16.45.126:45203 requested a full tablet report, sending...
I20260806 10:45:56.910640 11171 ts_manager.cc:194] Registered new tserver with Master: 3a0735e9c47c41c99041f8a0d3baef77 (127.16.45.66:40213)
I20260806 10:45:56.911453 11171 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:57501
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:45:56.955309 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45203
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:38759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:45:57.286155 11624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:57.286515 11624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:57.286682 11624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:57.294122 11624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:57.294253 11624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:57.294440 11624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:45:57.304487 11624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:38759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45203
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:57.305841 11624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:57.307227 11624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:57.321795 11631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:57.321760 11635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:57.321856 11632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:57.327925 11624 server_base.cc:1034] running on GCE node
I20260806 10:45:57.328608 11624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:57.329596 11624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:57.330830 11624 hybrid_clock.cc:648] HybridClock initialized: now 1786013157330770 us; error 50 us; skew 500 ppm
I20260806 10:45:57.331151 11624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:45:57 dist-test-slave-fgb3 krb5kdc[11110](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013157, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:45:57.334494 11624 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:45:57.336097 11624 webserver.cc:460] Webserver started at http://127.16.45.67:36243/ using document root <none> and password file <none>
I20260806 10:45:57.336831 11624 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:57.336952 11624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:57.337260 11624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:57.340312 11624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "dee870b30a3c45e5a37291af5507bd91"
format_stamp: "Formatted at 2026-08-06 10:45:57 on dist-test-slave-fgb3"
server_key: "a2b6a87a2576ab78deedf1ebd3bf73d4"
server_key_iv: "a26786d970b5e8b9ba71e16f6dd80423"
server_key_version: "encryptionkey@0"
I20260806 10:45:57.341097 11624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "dee870b30a3c45e5a37291af5507bd91"
format_stamp: "Formatted at 2026-08-06 10:45:57 on dist-test-slave-fgb3"
server_key: "a2b6a87a2576ab78deedf1ebd3bf73d4"
server_key_iv: "a26786d970b5e8b9ba71e16f6dd80423"
server_key_version: "encryptionkey@0"
I20260806 10:45:57.346220 11624 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 10:45:57.349650 11649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:57.350946 11624 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:45:57.351095 11624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "dee870b30a3c45e5a37291af5507bd91"
format_stamp: "Formatted at 2026-08-06 10:45:57 on dist-test-slave-fgb3"
server_key: "a2b6a87a2576ab78deedf1ebd3bf73d4"
server_key_iv: "a26786d970b5e8b9ba71e16f6dd80423"
server_key_version: "encryptionkey@0"
I20260806 10:45:57.351277 11624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:57.363710 11624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:57.367498 11624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:57.367769 11624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:57.368700 11624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:57.369999 11624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:57.370077 11624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:57.370187 11624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:57.370244 11624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:57.402192 11624 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:42405
I20260806 10:45:57.402233 11813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:42405 every 8 connection(s)
I20260806 10:45:57.403474 11624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:45:57.408550 11436 heartbeater.cc:503] Master 127.16.45.126:45203 was elected leader, sending a full tablet report...
I20260806 10:45:57.413859 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 11624
I20260806 10:45:57.414036 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:45:57.414583 16565 external_mini_cluster.cc:1428] Setting key 889c82500f5c8152f4c7dbc1f99559fe
Aug 06 10:45:57 dist-test-slave-fgb3 krb5kdc[11110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013157, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:45:57.423712 11438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.405858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:52135 (local address 127.16.45.126:45203)
0806 10:45:57.406038 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:57.406042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:57.407414 (+ 1372us) server_negotiation.cc:407] Connection header received
0806 10:45:57.409450 (+ 2036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:57.409455 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:57.409529 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:57.409603 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:57.411319 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.412081 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.413743 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.414208 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.414360 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.418367 (+ 4007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:57.418375 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:57.418379 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:57.418414 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:57.420885 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:57.421603 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:57.421608 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:57.421610 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:57.421753 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:57.422129 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:57.422133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:57.422135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:57.422487 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:57.422612 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:57.423254 (+ 642us) server_negotiation.cc:299] Negotiation successful
0806 10:45:57.423459 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 10:45:57.424664 11817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.406511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:45203 (local address 127.16.45.67:52135)
0806 10:45:57.407244 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:57.407285 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:57.409181 (+ 1896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:57.409865 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:57.409877 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:57.410599 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:57.411158 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:57.411175 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.412230 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.412235 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:57.413603 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:57.413618 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.414477 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.414486 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:57.414760 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.415538 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:45:57.415566 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:57.418115 (+ 2549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:57.421012 (+ 2897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:57.421019 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:57.421032 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:57.421459 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:57.421845 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:45:57.421848 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:45:57.421851 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:45:57.422031 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:45:57.422605 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:57.422611 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:57.422928 (+ 317us) client_negotiation.cc:769] Sending connection context
0806 10:45:57.423143 (+ 215us) client_negotiation.cc:240] Negotiation successful
0806 10:45:57.423537 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":277,"threads_started":1}
I20260806 10:45:57.426038 11814 heartbeater.cc:347] Connected to a master server at 127.16.45.126:45203
I20260806 10:45:57.426393 11814 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:57.427102 11814 heartbeater.cc:511] Master 127.16.45.126:45203 requested a full tablet report, sending...
I20260806 10:45:57.428601 11170 ts_manager.cc:194] Registered new tserver with Master: dee870b30a3c45e5a37291af5507bd91 (127.16.45.67:42405)
I20260806 10:45:57.429634 11170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:52135
I20260806 10:45:57.429772 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:45:57.447748 11438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.434536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47600 (local address 127.16.45.126:45203)
0806 10:45:57.434732 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:57.434739 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:57.435123 (+ 384us) server_negotiation.cc:407] Connection header received
0806 10:45:57.435345 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:57.435352 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:57.435416 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:57.435527 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:57.437022 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.437836 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.439295 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.439713 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.439820 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.442577 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:57.442581 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:57.442585 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:57.442617 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:57.444994 (+ 2377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:57.445731 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:57.445735 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:57.445738 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:57.445862 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:57.446333 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:57.446339 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:57.446343 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:57.446651 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:57.446900 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:57.447284 (+ 384us) server_negotiation.cc:299] Negotiation successful
0806 10:45:57.447472 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 10:45:57.451603 11170 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47600:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:45:57.458519 11170 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:45:57.486225 11835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.470433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53342 (local address 127.16.45.67:42405)
0806 10:45:57.478365 (+ 7932us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:57.478370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:57.478399 (+ 29us) server_negotiation.cc:407] Connection header received
0806 10:45:57.478477 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:57.478483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:57.478649 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:57.478825 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:57.479605 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.481068 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.483656 (+ 2588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.485044 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.485172 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.485402 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:57.485713 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 10:45:57.485885 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7766,"thread_start_us":7628,"threads_started":1}
I20260806 10:45:57.486343 11831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.470236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:42405 (local address 127.0.0.1:53342)
0806 10:45:57.477240 (+ 7004us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:57.477286 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:57.477501 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:57.478862 (+ 1361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:57.478869 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:57.478899 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:57.479341 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:57.479356 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.481256 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.481261 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:57.483501 (+ 2240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:57.483516 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.485227 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.485233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:57.485436 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.485502 (+ 66us) client_negotiation.cc:769] Sending connection context
0806 10:45:57.485651 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 10:45:57.485840 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6720,"mutex_wait_us":1,"thread_start_us":6551,"threads_started":1}
I20260806 10:45:57.486779 11833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.470357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:40213 (local address 127.0.0.1:36408)
0806 10:45:57.478772 (+ 8415us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:57.478788 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:57.478990 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:57.479638 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:57.479642 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:57.479667 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:57.480093 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:57.480106 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.481880 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.481886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:57.484234 (+ 2348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:57.484248 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.485984 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.485990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:57.486150 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.486189 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 10:45:57.486270 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 10:45:57.486415 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8281,"mutex_wait_us":25,"thread_start_us":8158,"threads_started":1}
I20260806 10:45:57.488443 11836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.470850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36408 (local address 127.16.45.66:40213)
0806 10:45:57.477897 (+ 7047us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:57.477907 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:57.478875 (+ 968us) server_negotiation.cc:407] Connection header received
0806 10:45:57.479224 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:57.479231 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:57.479470 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:57.479644 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:57.480285 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.481721 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.484423 (+ 2702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.485738 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.487043 (+ 1305us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.487217 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:57.487279 (+ 62us) server_negotiation.cc:299] Negotiation successful
0806 10:45:57.487443 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6861,"thread_start_us":6799,"threads_started":1}
I20260806 10:45:57.489282 11839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.479692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:34209 (local address 127.0.0.1:56506)
0806 10:45:57.480867 (+ 1175us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:57.480883 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:57.481079 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:57.481903 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:57.481908 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:57.481936 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:57.482494 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:57.482508 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.484970 (+ 2462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.484975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:57.487004 (+ 2029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:57.487019 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.488571 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.488578 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:57.488751 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.488782 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 10:45:57.488879 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 10:45:57.488997 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1062,"thread_start_us":934,"threads_started":1}
I20260806 10:45:57.489389 11837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.479154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56506 (local address 127.16.45.65:34209)
0806 10:45:57.480447 (+ 1293us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:57.480467 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:57.480971 (+ 504us) server_negotiation.cc:407] Connection header received
0806 10:45:57.481258 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:57.481265 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:57.481507 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:57.481659 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:57.482692 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.484253 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.487151 (+ 2898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.488373 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.488505 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.488720 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:57.488933 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 10:45:57.489085 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":266,"threads_started":1}
I20260806 10:45:57.490716 11720 tablet_service.cc:1467] Processing CreateTablet for tablet 5c41e409104b4a29855daf4ae60e5dcc (DEFAULT_TABLE table=test-table [id=c2d863a4074443fcabc01ae6b8225304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:45:57.492120 11720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c41e409104b4a29855daf4ae60e5dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:57.492229 11529 tablet_service.cc:1467] Processing CreateTablet for tablet 5c41e409104b4a29855daf4ae60e5dcc (DEFAULT_TABLE table=test-table [id=c2d863a4074443fcabc01ae6b8225304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:45:57.492974 11340 tablet_service.cc:1467] Processing CreateTablet for tablet 5c41e409104b4a29855daf4ae60e5dcc (DEFAULT_TABLE table=test-table [id=c2d863a4074443fcabc01ae6b8225304]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:45:57.493559 11529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c41e409104b4a29855daf4ae60e5dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:57.494258 11340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c41e409104b4a29855daf4ae60e5dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:57.502905 11840 tablet_bootstrap.cc:492] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91: Bootstrap starting.
I20260806 10:45:57.506793 11840 tablet_bootstrap.cc:654] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:57.507776 11842 tablet_bootstrap.cc:492] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436: Bootstrap starting.
I20260806 10:45:57.508028 11840 log.cc:824] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:57.508549 11841 tablet_bootstrap.cc:492] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77: Bootstrap starting.
I20260806 10:45:57.511277 11840 tablet_bootstrap.cc:492] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91: No bootstrap required, opened a new log
I20260806 10:45:57.511530 11840 ts_tablet_manager.cc:1397] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.002s
I20260806 10:45:57.512233 11841 tablet_bootstrap.cc:654] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:57.512233 11842 tablet_bootstrap.cc:654] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:57.513504 11842 log.cc:824] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:57.513487 11841 log.cc:824] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:57.516454 11842 tablet_bootstrap.cc:492] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436: No bootstrap required, opened a new log
I20260806 10:45:57.516685 11841 tablet_bootstrap.cc:492] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77: No bootstrap required, opened a new log
I20260806 10:45:57.516743 11842 ts_tablet_manager.cc:1397] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260806 10:45:57.516976 11841 ts_tablet_manager.cc:1397] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260806 10:45:57.521166 11840 raft_consensus.cc:348] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee870b30a3c45e5a37291af5507bd91" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42405 } } peers { permanent_uuid: "3a0735e9c47c41c99041f8a0d3baef77" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 40213 } } peers { permanent_uuid: "812e0742a59e482f942e79d99363d436" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34209 } }
I20260806 10:45:57.521643 11840 raft_consensus.cc:374] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:57.521782 11840 raft_consensus.cc:729] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dee870b30a3c45e5a37291af5507bd91, State: Initialized, Role: FOLLOWER
I20260806 10:45:57.522480 11840 consensus_queue.cc:260] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee870b30a3c45e5a37291af5507bd91" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42405 } } peers { permanent_uuid: "3a0735e9c47c41c99041f8a0d3baef77" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 40213 } } peers { permanent_uuid: "812e0742a59e482f942e79d99363d436" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34209 } }
I20260806 10:45:57.523622 11814 heartbeater.cc:503] Master 127.16.45.126:45203 was elected leader, sending a full tablet report...
I20260806 10:45:57.524415 11840 ts_tablet_manager.cc:1428] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260806 10:45:57.524721 11842 raft_consensus.cc:348] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee870b30a3c45e5a37291af5507bd91" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42405 } } peers { permanent_uuid: "3a0735e9c47c41c99041f8a0d3baef77" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 40213 } } peers { permanent_uuid: "812e0742a59e482f942e79d99363d436" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34209 } }
I20260806 10:45:57.525122 11842 raft_consensus.cc:374] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:57.525223 11842 raft_consensus.cc:729] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812e0742a59e482f942e79d99363d436, State: Initialized, Role: FOLLOWER
I20260806 10:45:57.525803 11842 consensus_queue.cc:260] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee870b30a3c45e5a37291af5507bd91" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42405 } } peers { permanent_uuid: "3a0735e9c47c41c99041f8a0d3baef77" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 40213 } } peers { permanent_uuid: "812e0742a59e482f942e79d99363d436" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34209 } }
I20260806 10:45:57.526649 11841 raft_consensus.cc:348] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee870b30a3c45e5a37291af5507bd91" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42405 } } peers { permanent_uuid: "3a0735e9c47c41c99041f8a0d3baef77" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 40213 } } peers { permanent_uuid: "812e0742a59e482f942e79d99363d436" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34209 } }
I20260806 10:45:57.527040 11841 raft_consensus.cc:374] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:57.527135 11841 raft_consensus.cc:729] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a0735e9c47c41c99041f8a0d3baef77, State: Initialized, Role: FOLLOWER
I20260806 10:45:57.527652 11841 consensus_queue.cc:260] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee870b30a3c45e5a37291af5507bd91" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42405 } } peers { permanent_uuid: "3a0735e9c47c41c99041f8a0d3baef77" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 40213 } } peers { permanent_uuid: "812e0742a59e482f942e79d99363d436" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34209 } }
I20260806 10:45:57.528438 11849 raft_consensus.cc:482] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:45:57.528931 11842 ts_tablet_manager.cc:1428] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436: Time spent starting tablet: real 0.012s user 0.001s sys 0.009s
I20260806 10:45:57.528765 11849 raft_consensus.cc:504] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee870b30a3c45e5a37291af5507bd91" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42405 } } peers { permanent_uuid: "3a0735e9c47c41c99041f8a0d3baef77" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 40213 } } peers { permanent_uuid: "812e0742a59e482f942e79d99363d436" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34209 } }
I20260806 10:45:57.530859 11618 heartbeater.cc:503] Master 127.16.45.126:45203 was elected leader, sending a full tablet report...
I20260806 10:45:57.531821 11849 leader_election.cc:288] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dee870b30a3c45e5a37291af5507bd91 (127.16.45.67:42405), 3a0735e9c47c41c99041f8a0d3baef77 (127.16.45.66:40213)
I20260806 10:45:57.533155 11841 ts_tablet_manager.cc:1428] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77: Time spent starting tablet: real 0.016s user 0.011s sys 0.003s
I20260806 10:45:57.540341 11835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.531550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:40551 (local address 127.16.45.67:42405)
0806 10:45:57.531719 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:57.531725 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:57.533926 (+ 2201us) server_negotiation.cc:407] Connection header received
0806 10:45:57.534115 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:57.534120 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:57.534193 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:57.534288 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:57.535201 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.536318 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.538184 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.539406 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.539582 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.539654 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:57.539966 (+ 312us) server_negotiation.cc:299] Negotiation successful
0806 10:45:57.540099 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 10:45:57.540432 11852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.531137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:42405 (local address 127.16.45.65:40551)
0806 10:45:57.533842 (+ 2705us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:57.533860 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:57.533999 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:57.534437 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:57.534442 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:57.534481 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:57.535062 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:57.535078 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.536452 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.536457 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:57.538038 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:57.538053 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.539624 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.539631 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:57.539791 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.539825 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 10:45:57.539935 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 10:45:57.540075 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2571,"thread_start_us":3289,"threads_started":1}
I20260806 10:45:57.540781 11836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.531506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:47409 (local address 127.16.45.66:40213)
0806 10:45:57.531720 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:57.531726 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:57.534564 (+ 2838us) server_negotiation.cc:407] Connection header received
0806 10:45:57.534822 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:57.534827 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:57.534896 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:57.534987 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:45:57.535610 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.536605 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.538420 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.539597 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.539739 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.539787 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:57.540257 (+ 470us) server_negotiation.cc:299] Negotiation successful
0806 10:45:57.540385 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 10:45:57.540849 11851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.531149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:40213 (local address 127.16.45.65:47409)
0806 10:45:57.534468 (+ 3319us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:57.534484 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:57.534684 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:57.535006 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:57.535014 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:57.535042 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:45:57.535425 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:57.535436 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.536748 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.536752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:57.538251 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:57.538263 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.539920 (+ 1657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.539926 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:57.540092 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.540123 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 10:45:57.540220 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 10:45:57.540334 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3202,"mutex_wait_us":624,"thread_start_us":1720,"threads_started":1}
I20260806 10:45:57.541435 11753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c41e409104b4a29855daf4ae60e5dcc" candidate_uuid: "812e0742a59e482f942e79d99363d436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dee870b30a3c45e5a37291af5507bd91" is_pre_election: true
I20260806 10:45:57.541723 11555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c41e409104b4a29855daf4ae60e5dcc" candidate_uuid: "812e0742a59e482f942e79d99363d436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0735e9c47c41c99041f8a0d3baef77" is_pre_election: true
I20260806 10:45:57.541898 11753 raft_consensus.cc:2454] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812e0742a59e482f942e79d99363d436 in term 0.
I20260806 10:45:57.542150 11555 raft_consensus.cc:2454] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812e0742a59e482f942e79d99363d436 in term 0.
I20260806 10:45:57.542598 11277 leader_election.cc:302] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 812e0742a59e482f942e79d99363d436, dee870b30a3c45e5a37291af5507bd91; no voters:
I20260806 10:45:57.543004 11849 raft_consensus.cc:2781] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:45:57.543130 11849 raft_consensus.cc:482] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:45:57.543236 11849 raft_consensus.cc:3037] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:57.545364 11849 raft_consensus.cc:504] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee870b30a3c45e5a37291af5507bd91" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42405 } } peers { permanent_uuid: "3a0735e9c47c41c99041f8a0d3baef77" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 40213 } } peers { permanent_uuid: "812e0742a59e482f942e79d99363d436" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34209 } }
I20260806 10:45:57.545933 11849 leader_election.cc:288] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [CANDIDATE]: Term 1 election: Requested vote from peers dee870b30a3c45e5a37291af5507bd91 (127.16.45.67:42405), 3a0735e9c47c41c99041f8a0d3baef77 (127.16.45.66:40213)
I20260806 10:45:57.546425 11753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c41e409104b4a29855daf4ae60e5dcc" candidate_uuid: "812e0742a59e482f942e79d99363d436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dee870b30a3c45e5a37291af5507bd91"
I20260806 10:45:57.546424 11555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c41e409104b4a29855daf4ae60e5dcc" candidate_uuid: "812e0742a59e482f942e79d99363d436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a0735e9c47c41c99041f8a0d3baef77"
I20260806 10:45:57.546633 11555 raft_consensus.cc:3037] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:57.546634 11753 raft_consensus.cc:3037] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:57.549805 11753 raft_consensus.cc:2454] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812e0742a59e482f942e79d99363d436 in term 1.
I20260806 10:45:57.549804 11555 raft_consensus.cc:2454] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812e0742a59e482f942e79d99363d436 in term 1.
I20260806 10:45:57.550212 11278 leader_election.cc:302] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a0735e9c47c41c99041f8a0d3baef77, 812e0742a59e482f942e79d99363d436; no voters:
I20260806 10:45:57.550551 11849 raft_consensus.cc:2781] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:45:57.551005 11849 raft_consensus.cc:686] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 1 LEADER]: Becoming Leader. State: Replica: 812e0742a59e482f942e79d99363d436, State: Running, Role: LEADER
I20260806 10:45:57.551656 11849 consensus_queue.cc:237] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee870b30a3c45e5a37291af5507bd91" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42405 } } peers { permanent_uuid: "3a0735e9c47c41c99041f8a0d3baef77" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 40213 } } peers { permanent_uuid: "812e0742a59e482f942e79d99363d436" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34209 } }
I20260806 10:45:57.556325 11171 catalog_manager.cc:5495] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812e0742a59e482f942e79d99363d436 (127.16.45.65). New cstate: current_term: 1 leader_uuid: "812e0742a59e482f942e79d99363d436" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dee870b30a3c45e5a37291af5507bd91" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a0735e9c47c41c99041f8a0d3baef77" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 40213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812e0742a59e482f942e79d99363d436" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 34209 } health_report { overall_health: HEALTHY } } }
I20260806 10:45:57.580404 11837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.575049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56522 (local address 127.16.45.65:34209)
0806 10:45:57.575231 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:57.575236 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:57.575353 (+ 117us) server_negotiation.cc:407] Connection header received
0806 10:45:57.575486 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:57.575489 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:57.575569 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:57.575704 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:45:57.576036 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.576767 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.578122 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.578607 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.578708 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.579223 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:45:57.579803 (+ 580us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:45:57.579964 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:57.580150 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 10:45:57.580196 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 10:45:57.588929 11753 raft_consensus.cc:1261] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91 [term 1 FOLLOWER]: Refusing update from remote peer 812e0742a59e482f942e79d99363d436: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:45:57.588928 11555 raft_consensus.cc:1261] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77 [term 1 FOLLOWER]: Refusing update from remote peer 812e0742a59e482f942e79d99363d436: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:45:57.590014 11853 consensus_queue.cc:1035] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dee870b30a3c45e5a37291af5507bd91" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 42405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:45:57.590397 11849 consensus_queue.cc:1035] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a0735e9c47c41c99041f8a0d3baef77" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 40213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:45:57.607478 11860 mvcc.cc:205] Tried to move back new op lower bound from 7315509893473959936 to 7315509893335859200. Current Snapshot: MvccSnapshot[applied={T|T < 7315509893473959936 or (T in {7315509893473959936})}]
I20260806 10:45:57.618191 11171 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:45:57.618541 11171 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:45:57.622437 11171 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b3bb68505a3942eebf82cd25eeb18ff9: Sending DeleteTablet for 3 replicas of tablet 5c41e409104b4a29855daf4ae60e5dcc
I20260806 10:45:57.623586 11720 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c41e409104b4a29855daf4ae60e5dcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:45:57 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:53342
I20260806 10:45:57.623699 11529 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c41e409104b4a29855daf4ae60e5dcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:45:57 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:36408
I20260806 10:45:57.624707 11340 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c41e409104b4a29855daf4ae60e5dcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:45:57 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:56506
I20260806 10:45:57.627075 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 11255
I20260806 10:45:57.632596 11871 tablet_replica.cc:330] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77: stopping tablet replica
I20260806 10:45:57.632740 11872 tablet_replica.cc:330] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436: stopping tablet replica
I20260806 10:45:57.633152 11872 raft_consensus.cc:2229] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:45:57.633152 11871 raft_consensus.cc:2229] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:45:57.633754 11871 raft_consensus.cc:2258] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:45:57.633829 11872 raft_consensus.cc:2258] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:45:57.634627 11870 tablet_replica.cc:330] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91: stopping tablet replica
I20260806 10:45:57.635052 11870 raft_consensus.cc:2229] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:45:57.635512 11870 raft_consensus.cc:2258] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:45:57.636739 11871 ts_tablet_manager.cc:1905] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:45:57.636754 11872 ts_tablet_manager.cc:1905] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:45:57.644170 11871 ts_tablet_manager.cc:1918] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:45:57.644474 11871 log.cc:1196] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/5c41e409104b4a29855daf4ae60e5dcc
I20260806 10:45:57.644678 11872 ts_tablet_manager.cc:1918] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:45:57.644909 11872 log.cc:1196] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/5c41e409104b4a29855daf4ae60e5dcc
I20260806 10:45:57.645233 11871 ts_tablet_manager.cc:1939] T 5c41e409104b4a29855daf4ae60e5dcc P 3a0735e9c47c41c99041f8a0d3baef77: Deleting consensus metadata
I20260806 10:45:57.645532 11872 ts_tablet_manager.cc:1939] T 5c41e409104b4a29855daf4ae60e5dcc P 812e0742a59e482f942e79d99363d436: Deleting consensus metadata
Aug 06 10:45:57 dist-test-slave-fgb3 krb5kdc[11110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:45:57.647522 11147 catalog_manager.cc:4841] TS 812e0742a59e482f942e79d99363d436 (127.16.45.65:34209): tablet 5c41e409104b4a29855daf4ae60e5dcc (table test-table [id=c2d863a4074443fcabc01ae6b8225304]) successfully deleted
I20260806 10:45:57.647881 11147 catalog_manager.cc:4841] TS 3a0735e9c47c41c99041f8a0d3baef77 (127.16.45.66:40213): tablet 5c41e409104b4a29855daf4ae60e5dcc (table test-table [id=c2d863a4074443fcabc01ae6b8225304]) successfully deleted
I20260806 10:45:57.648627 11870 ts_tablet_manager.cc:1905] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:45:57.654183 11870 ts_tablet_manager.cc:1918] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:45:57.654374 11870 log.cc:1196] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/5c41e409104b4a29855daf4ae60e5dcc
I20260806 10:45:57.654912 11870 ts_tablet_manager.cc:1939] T 5c41e409104b4a29855daf4ae60e5dcc P dee870b30a3c45e5a37291af5507bd91: Deleting consensus metadata
I20260806 10:45:57.656538 11145 catalog_manager.cc:4841] TS dee870b30a3c45e5a37291af5507bd91 (127.16.45.67:42405): tablet 5c41e409104b4a29855daf4ae60e5dcc (table test-table [id=c2d863a4074443fcabc01ae6b8225304]) successfully deleted
I20260806 10:45:57.659525 11837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.627881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56524 (local address 127.16.45.65:34209)
0806 10:45:57.628079 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:57.628086 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:57.636278 (+ 8192us) server_negotiation.cc:407] Connection header received
0806 10:45:57.636587 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:57.636592 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:57.636677 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:57.636759 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:57.638779 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.639986 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.641807 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.642557 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.642670 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.651895 (+ 9225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:57.651911 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:57.651930 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:57.651993 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:57.656199 (+ 4206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:57.657127 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:57.657137 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:57.657141 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:57.657359 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:57.657783 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:57.657789 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:57.657793 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:57.658276 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:57.658652 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:57.658868 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 10:45:57.659138 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 10:45:57.660224 11426 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:57.758888 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 11255
I20260806 10:45:57.781744 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 11443
Aug 06 10:45:57 dist-test-slave-fgb3 krb5kdc[11110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:45:57.796658 11836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.782524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36418 (local address 127.16.45.66:40213)
0806 10:45:57.782697 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:57.782702 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:57.782721 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:45:57.782878 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:57.782881 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:57.782950 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:57.783051 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:57.784400 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.785168 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.786514 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.786919 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.787021 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.791197 (+ 4176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:57.791214 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:57.791229 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:57.791294 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:57.794233 (+ 2939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:57.794940 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:57.794948 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:57.794951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:57.795070 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:57.795363 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:57.795365 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:57.795367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:57.795740 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:57.795963 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:57.796220 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 10:45:57.796395 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:45:57.797297 11611 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:57.885376 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 11443
I20260806 10:45:57.905761 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 11624
Aug 06 10:45:57 dist-test-slave-fgb3 krb5kdc[11110](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:45:57.921209 11835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:57.906656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53346 (local address 127.16.45.67:42405)
0806 10:45:57.906830 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:57.906834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:57.906852 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:45:57.906908 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:57.906911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:57.906973 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:57.907069 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:57.908448 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.909216 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.910703 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:57.911108 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:57.911203 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:57.915561 (+ 4358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:57.915580 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:57.915597 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:45:57.915636 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:57.918664 (+ 3028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:57.919356 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:57.919365 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:57.919368 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:57.919524 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:45:57.919856 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:45:57.919859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:45:57.919861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:45:57.920258 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:57.920485 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:57.920749 (+ 264us) server_negotiation.cc:299] Negotiation successful
0806 10:45:57.920938 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 10:45:57.921970 11808 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:58.010746 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 11624
I20260806 10:45:58.029213 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 11127
I20260806 10:45:58.030411 11214 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:45:58.142154 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 11127
2026-08-06T10:45:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4388 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T10:45:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:45:58Z Disabled control of system clock
I20260806 10:45:58.233790 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:45873
--webserver_interface=127.16.45.126
--webserver_port=0
--builtin_ntp_servers=127.16.45.84:44413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:45873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 10:45:58.567097 11884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:58.567396 11884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:58.567523 11884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:58.574708 11884 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:45:58.574812 11884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:58.574856 11884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:58.574935 11884 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:45:58.574992 11884 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:45:58.584065 11884 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:44413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:45873
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:45873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:58.585326 11884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:58.587090 11884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:58.598790 11894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:58.599011 11890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:58.599063 11897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:58.600081 11884 server_base.cc:1034] running on GCE node
I20260806 10:45:58.600906 11884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:58.602463 11884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:58.603674 11884 hybrid_clock.cc:648] HybridClock initialized: now 1786013158603628 us; error 38 us; skew 500 ppm
I20260806 10:45:58.604004 11884 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:45:58.606253 11884 webserver.cc:460] Webserver started at http://127.16.45.126:45973/ using document root <none> and password file <none>
I20260806 10:45:58.606953 11884 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:58.607044 11884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:58.607343 11884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:58.610251 11884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "3ed0a7da70d64d549dd7e821aa645c67"
format_stamp: "Formatted at 2026-08-06 10:45:58 on dist-test-slave-fgb3"
server_key: "2b18e6e1e604d549047945badee24934"
server_key_iv: "df3ffa15a4bb7ad61e1ce387933dbf35"
server_key_version: "encryptionkey@0"
I20260806 10:45:58.611068 11884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "3ed0a7da70d64d549dd7e821aa645c67"
format_stamp: "Formatted at 2026-08-06 10:45:58 on dist-test-slave-fgb3"
server_key: "2b18e6e1e604d549047945badee24934"
server_key_iv: "df3ffa15a4bb7ad61e1ce387933dbf35"
server_key_version: "encryptionkey@0"
I20260806 10:45:58.616132 11884 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 10:45:58.619578 11905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:58.620941 11884 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:45:58.621096 11884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "3ed0a7da70d64d549dd7e821aa645c67"
format_stamp: "Formatted at 2026-08-06 10:45:58 on dist-test-slave-fgb3"
server_key: "2b18e6e1e604d549047945badee24934"
server_key_iv: "df3ffa15a4bb7ad61e1ce387933dbf35"
server_key_version: "encryptionkey@0"
I20260806 10:45:58.621284 11884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:58.642216 11884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:58.643069 11884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:58.643324 11884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:58.659610 11884 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:45873
I20260806 10:45:58.659616 11975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:45873 every 8 connection(s)
I20260806 10:45:58.661002 11884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:45:58.664739 11976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:45:58.671343 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 11884
I20260806 10:45:58.671509 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:45:58.671903 16565 external_mini_cluster.cc:1428] Setting key 0132cccbcc2eff632e536f90f4c8631e
I20260806 10:45:58.675302 11976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67: Bootstrap starting.
I20260806 10:45:58.678794 11976 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67: Neither blocks nor log segments found. Creating new log.
I20260806 10:45:58.679904 11976 log.cc:824] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67: Log is configured to *not* fsync() on all Append() calls
I20260806 10:45:58.683019 11976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67: No bootstrap required, opened a new log
I20260806 10:45:58.685559 11980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:58.673741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37014 (local address 127.16.45.126:45873)
0806 10:45:58.674715 (+ 974us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:58.674726 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:58.674767 (+ 41us) server_negotiation.cc:407] Connection header received
0806 10:45:58.676542 (+ 1775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:58.676565 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:58.677056 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:58.677379 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:58.678066 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:58.679484 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:58.681144 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:58.681808 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:58.681945 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:58.683265 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:58.683274 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:58.683289 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:45:58.683818 (+ 529us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:58.683917 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:45:58.683945 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:58.684041 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:58.684254 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 10:45:58.684572 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":327,"threads_started":1}
I20260806 10:45:58.691075 11976 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ed0a7da70d64d549dd7e821aa645c67" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45873 } }
I20260806 10:45:58.691416 11976 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:45:58.691520 11976 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ed0a7da70d64d549dd7e821aa645c67, State: Initialized, Role: FOLLOWER
I20260806 10:45:58.692091 11976 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ed0a7da70d64d549dd7e821aa645c67" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45873 } }
I20260806 10:45:58.692301 11976 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:45:58.692427 11976 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:45:58.692587 11976 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:45:58.694841 11976 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ed0a7da70d64d549dd7e821aa645c67" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45873 } }
I20260806 10:45:58.695331 11976 leader_election.cc:302] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ed0a7da70d64d549dd7e821aa645c67; no voters:
I20260806 10:45:58.695941 11976 leader_election.cc:288] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:45:58.696074 11982 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:45:58.696754 11982 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [term 1 LEADER]: Becoming Leader. State: Replica: 3ed0a7da70d64d549dd7e821aa645c67, State: Running, Role: LEADER
I20260806 10:45:58.697346 11982 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ed0a7da70d64d549dd7e821aa645c67" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45873 } }
I20260806 10:45:58.698185 11976 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:45:58.700177 11984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ed0a7da70d64d549dd7e821aa645c67. Latest consensus state: current_term: 1 leader_uuid: "3ed0a7da70d64d549dd7e821aa645c67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ed0a7da70d64d549dd7e821aa645c67" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45873 } } }
I20260806 10:45:58.700716 11983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ed0a7da70d64d549dd7e821aa645c67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ed0a7da70d64d549dd7e821aa645c67" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 45873 } } }
I20260806 10:45:58.701126 11983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [sys.catalog]: This master's current role is: LEADER
I20260806 10:45:58.701007 11984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67 [sys.catalog]: This master's current role is: LEADER
I20260806 10:45:58.703387 11993 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:45:58.708426 11993 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:45:58.717126 11993 catalog_manager.cc:1347] Generated new cluster ID: 7377a158b2b5469f86290fc872de9222
I20260806 10:45:58.717250 11993 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:45:58.739440 11993 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:45:58.740792 11993 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:45:58.754237 11993 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67: Generated new TSK 0
I20260806 10:45:58.755169 11993 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:45:58.764357 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45873
--builtin_ntp_servers=127.16.45.84:44413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 10:45:59.121225 12006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:59.121524 12006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:59.121652 12006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:59.129114 12006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:59.129240 12006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:59.129401 12006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:45:59.138849 12006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:44413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:59.140321 12006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:59.142071 12006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:59.155011 12016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:59.155077 12014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:59.155102 12013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:59.155853 12006 server_base.cc:1034] running on GCE node
I20260806 10:45:59.156457 12006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:59.157420 12006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:59.158634 12006 hybrid_clock.cc:648] HybridClock initialized: now 1786013159158588 us; error 33 us; skew 500 ppm
I20260806 10:45:59.158946 12006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:45:59.161267 12006 webserver.cc:460] Webserver started at http://127.16.45.65:38643/ using document root <none> and password file <none>
I20260806 10:45:59.161952 12006 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:59.162067 12006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:59.162405 12006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:59.165328 12006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "5072c31afd5149908d6de438afc4deef"
format_stamp: "Formatted at 2026-08-06 10:45:59 on dist-test-slave-fgb3"
server_key: "2a62fd2f7fe66f5804be595e741b8841"
server_key_iv: "bb20a0f3172ab4c466e727d22b5e227d"
server_key_version: "encryptionkey@0"
I20260806 10:45:59.166128 12006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "5072c31afd5149908d6de438afc4deef"
format_stamp: "Formatted at 2026-08-06 10:45:59 on dist-test-slave-fgb3"
server_key: "2a62fd2f7fe66f5804be595e741b8841"
server_key_iv: "bb20a0f3172ab4c466e727d22b5e227d"
server_key_version: "encryptionkey@0"
I20260806 10:45:59.171324 12006 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260806 10:45:59.174775 12023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:59.176100 12006 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 10:45:59.176247 12006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "5072c31afd5149908d6de438afc4deef"
format_stamp: "Formatted at 2026-08-06 10:45:59 on dist-test-slave-fgb3"
server_key: "2a62fd2f7fe66f5804be595e741b8841"
server_key_iv: "bb20a0f3172ab4c466e727d22b5e227d"
server_key_version: "encryptionkey@0"
I20260806 10:45:59.176440 12006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:59.200830 12006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:59.201709 12006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:59.202009 12006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:59.203161 12006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:59.204761 12006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:59.204856 12006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:59.204972 12006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:59.205044 12006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:59.238605 12006 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:41653
I20260806 10:45:59.238680 12176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:41653 every 8 connection(s)
I20260806 10:45:59.239985 12006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:45:59.241986 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 12006
I20260806 10:45:59.242156 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:45:59.242722 16565 external_mini_cluster.cc:1428] Setting key 0048d70555cc45722e9473745e31a26b
I20260806 10:45:59.245726 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45873
--builtin_ntp_servers=127.16.45.84:44413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 10:45:59.252674 12179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:59.242619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:48273 (local address 127.16.45.126:45873)
0806 10:45:59.243112 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:59.243118 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:59.244423 (+ 1305us) server_negotiation.cc:407] Connection header received
0806 10:45:59.246427 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:59.246432 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:59.246516 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:59.246613 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:59.247701 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:59.248449 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:59.249968 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:59.250423 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:59.250536 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:59.251862 (+ 1326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:59.251867 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:59.251870 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:45:59.251889 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:59.251933 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:45:59.251945 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:59.252021 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:59.252234 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 10:45:59.252337 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":245,"threads_started":1}
I20260806 10:45:59.253687 12182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:59.243215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:45873 (local address 127.16.45.65:48273)
0806 10:45:59.244242 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:59.244300 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:59.246143 (+ 1843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:59.246858 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:59.246867 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:59.246964 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:59.247536 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:59.247553 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:59.248598 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:59.248602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:59.249830 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:59.249843 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:59.250651 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:59.250658 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:59.250887 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:59.251545 (+ 658us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:45:59.251547 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:59.251588 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:45:59.251670 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:59.252035 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:59.252047 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:59.252055 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 10:45:59.252211 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 10:45:59.252625 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":298,"threads_started":1}
I20260806 10:45:59.255396 12177 heartbeater.cc:347] Connected to a master server at 127.16.45.126:45873
I20260806 10:45:59.255712 12177 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:59.256568 12177 heartbeater.cc:511] Master 127.16.45.126:45873 requested a full tablet report, sending...
I20260806 10:45:59.258739 11925 ts_manager.cc:194] Registered new tserver with Master: 5072c31afd5149908d6de438afc4deef (127.16.45.65:41653)
I20260806 10:45:59.260180 11925 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.45.65:48273
W20260806 10:45:59.584156 12183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:45:59.584453 12183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:45:59.584573 12183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:45:59.591696 12183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:45:59.591811 12183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:45:59.591948 12183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:45:59.601295 12183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:44413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:45:59.602622 12183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:45:59.604560 12183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:45:59.617380 12190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:59.617359 12192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:45:59.617614 12194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:45:59.618047 12183 server_base.cc:1034] running on GCE node
I20260806 10:45:59.618767 12183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:45:59.619668 12183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:45:59.620870 12183 hybrid_clock.cc:648] HybridClock initialized: now 1786013159620829 us; error 32 us; skew 500 ppm
I20260806 10:45:59.621153 12183 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:45:59.627712 12183 webserver.cc:460] Webserver started at http://127.16.45.66:46369/ using document root <none> and password file <none>
I20260806 10:45:59.628392 12183 fs_manager.cc:359] Metadata directory not provided
I20260806 10:45:59.628489 12183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:45:59.628752 12183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:45:59.631642 12183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "6f8b5937a18047e891563c3d2039c16c"
format_stamp: "Formatted at 2026-08-06 10:45:59 on dist-test-slave-fgb3"
server_key: "083fc3d4557976e72d4d05894d47f04a"
server_key_iv: "00d05b701444d9448a0da8b86e192a93"
server_key_version: "encryptionkey@0"
I20260806 10:45:59.632365 12183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "6f8b5937a18047e891563c3d2039c16c"
format_stamp: "Formatted at 2026-08-06 10:45:59 on dist-test-slave-fgb3"
server_key: "083fc3d4557976e72d4d05894d47f04a"
server_key_iv: "00d05b701444d9448a0da8b86e192a93"
server_key_version: "encryptionkey@0"
I20260806 10:45:59.637445 12183 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:45:59.640843 12203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:59.642159 12183 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:45:59.642287 12183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "6f8b5937a18047e891563c3d2039c16c"
format_stamp: "Formatted at 2026-08-06 10:45:59 on dist-test-slave-fgb3"
server_key: "083fc3d4557976e72d4d05894d47f04a"
server_key_iv: "00d05b701444d9448a0da8b86e192a93"
server_key_version: "encryptionkey@0"
I20260806 10:45:59.642524 12183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:45:59.673009 12183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:45:59.673992 12183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:45:59.674304 12183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:45:59.675520 12183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:45:59.677307 12183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:45:59.677430 12183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:59.677537 12183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:45:59.677613 12183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:45:59.709519 12183 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:33617
I20260806 10:45:59.709537 12377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:33617 every 8 connection(s)
I20260806 10:45:59.710789 12183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:45:59.716439 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 12183
I20260806 10:45:59.716634 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:45:59.717141 16565 external_mini_cluster.cc:1428] Setting key 2215e9fe7f535ccd07672fa3676dda60
I20260806 10:45:59.719993 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45873
--builtin_ntp_servers=127.16.45.84:44413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 10:45:59.723166 12179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:59.713184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:53855 (local address 127.16.45.126:45873)
0806 10:45:59.713407 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 10:45:59.713414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:45:59.714766 (+ 1352us) server_negotiation.cc:407] Connection header received
0806 10:45:59.716497 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:45:59.716503 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:45:59.716600 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:45:59.716715 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:45:59.717813 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:59.718813 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:59.720375 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:45:59.720909 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:45:59.721037 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:59.722374 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:45:59.722381 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:45:59.722386 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:45:59.722408 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:45:59.722446 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:45:59.722459 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:45:59.722535 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 10:45:59.722753 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 10:45:59.722847 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 10:45:59.724164 12381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:45:59.713694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:45873 (local address 127.16.45.66:53855)
0806 10:45:59.714622 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0806 10:45:59.714658 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 10:45:59.716227 (+ 1569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:45:59.716948 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:45:59.716956 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:45:59.717040 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:45:59.717637 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:59.717659 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:59.718957 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:59.718961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:59.720245 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:45:59.720258 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:45:59.721144 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:45:59.721153 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:45:59.721382 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:45:59.722032 (+ 650us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:45:59.722035 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:45:59.722079 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:45:59.722154 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:45:59.722551 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:45:59.722562 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:45:59.722569 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 10:45:59.722728 (+ 159us) client_negotiation.cc:240] Negotiation successful
0806 10:45:59.723119 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":264,"threads_started":1}
I20260806 10:45:59.725471 12378 heartbeater.cc:347] Connected to a master server at 127.16.45.126:45873
I20260806 10:45:59.725795 12378 heartbeater.cc:464] Registering TS with master...
I20260806 10:45:59.726689 12378 heartbeater.cc:511] Master 127.16.45.126:45873 requested a full tablet report, sending...
I20260806 10:45:59.728152 11925 ts_manager.cc:194] Registered new tserver with Master: 6f8b5937a18047e891563c3d2039c16c (127.16.45.66:33617)
I20260806 10:45:59.728910 11925 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.45.66:53855
W20260806 10:46:00.069871 12382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:00.070156 12382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:00.070271 12382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:00.077550 12382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:00.077651 12382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:00.077785 12382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:46:00.087111 12382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:44413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:45873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:00.088498 12382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:00.090307 12382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:00.103220 12390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:00.103229 12394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:00.103708 12388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:00.104125 12382 server_base.cc:1034] running on GCE node
I20260806 10:46:00.104689 12382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:00.105598 12382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:00.106791 12382 hybrid_clock.cc:648] HybridClock initialized: now 1786013160106741 us; error 43 us; skew 500 ppm
I20260806 10:46:00.107105 12382 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:46:00.109220 12382 webserver.cc:460] Webserver started at http://127.16.45.67:35013/ using document root <none> and password file <none>
I20260806 10:46:00.109879 12382 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:00.109980 12382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:00.110271 12382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:00.113065 12382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "7398f64fc1c147aeb3e21ee3eb857d93"
format_stamp: "Formatted at 2026-08-06 10:46:00 on dist-test-slave-fgb3"
server_key: "5c2bcb3da6f2c052b98bab364db77ac6"
server_key_iv: "c18656f748c579da4765f102dc56a692"
server_key_version: "encryptionkey@0"
I20260806 10:46:00.113811 12382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "7398f64fc1c147aeb3e21ee3eb857d93"
format_stamp: "Formatted at 2026-08-06 10:46:00 on dist-test-slave-fgb3"
server_key: "5c2bcb3da6f2c052b98bab364db77ac6"
server_key_iv: "c18656f748c579da4765f102dc56a692"
server_key_version: "encryptionkey@0"
I20260806 10:46:00.118791 12382 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 10:46:00.121999 12403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:00.123291 12382 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:46:00.123451 12382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "7398f64fc1c147aeb3e21ee3eb857d93"
format_stamp: "Formatted at 2026-08-06 10:46:00 on dist-test-slave-fgb3"
server_key: "5c2bcb3da6f2c052b98bab364db77ac6"
server_key_iv: "c18656f748c579da4765f102dc56a692"
server_key_version: "encryptionkey@0"
I20260806 10:46:00.123654 12382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:00.156672 12382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:00.157553 12382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:00.157867 12382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:00.158933 12382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:46:00.160409 12382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:46:00.160511 12382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:00.160620 12382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:46:00.160688 12382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:00.191725 12382 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:39513
I20260806 10:46:00.191790 12553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:39513 every 8 connection(s)
I20260806 10:46:00.193080 12382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:46:00.201180 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 12382
I20260806 10:46:00.201380 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:46:00.201805 16565 external_mini_cluster.cc:1428] Setting key 7601e1178cd8ea7893a1811c679d50ec
I20260806 10:46:00.206230 12179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.195703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:44585 (local address 127.16.45.126:45873)
0806 10:46:00.195867 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:00.195871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:00.197390 (+ 1519us) server_negotiation.cc:407] Connection header received
0806 10:46:00.199309 (+ 1919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:00.199314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:00.199400 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:00.199504 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:00.200568 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.201404 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.203292 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.203841 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.203954 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.205414 (+ 1460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:00.205420 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:00.205425 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:00.205446 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:00.205478 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:00.205490 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:00.205567 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:00.205790 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 10:46:00.205891 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 10:46:00.207338 12557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.196185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:45873 (local address 127.16.45.67:44585)
0806 10:46:00.197227 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.197271 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:00.198986 (+ 1715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:00.199730 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:00.199738 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:00.199824 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:00.200404 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:00.200421 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.201583 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.201587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:00.203128 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:00.203148 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.204076 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.204084 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:00.204323 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.205093 (+ 770us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:46:00.205095 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:00.205138 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:46:00.205218 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:00.205582 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:00.205595 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:00.205604 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 10:46:00.205765 (+ 161us) client_negotiation.cc:240] Negotiation successful
0806 10:46:00.206188 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":323,"threads_started":1}
I20260806 10:46:00.208707 12554 heartbeater.cc:347] Connected to a master server at 127.16.45.126:45873
I20260806 10:46:00.209080 12554 heartbeater.cc:464] Registering TS with master...
I20260806 10:46:00.210012 12554 heartbeater.cc:511] Master 127.16.45.126:45873 requested a full tablet report, sending...
I20260806 10:46:00.211609 11925 ts_manager.cc:194] Registered new tserver with Master: 7398f64fc1c147aeb3e21ee3eb857d93 (127.16.45.67:39513)
I20260806 10:46:00.212463 11925 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.45.67:44585
I20260806 10:46:00.217216 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:46:00.227589 12179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.221429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37030 (local address 127.16.45.126:45873)
0806 10:46:00.221662 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:00.221669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:00.222037 (+ 368us) server_negotiation.cc:407] Connection header received
0806 10:46:00.222157 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:00.222160 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:00.222238 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:00.222387 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:00.222810 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.223546 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.224893 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.225491 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.225626 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.226717 (+ 1091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:00.226722 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:00.226725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:00.226743 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:00.226784 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:00.226796 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:00.226958 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:00.227175 (+ 217us) server_negotiation.cc:299] Negotiation successful
0806 10:46:00.227267 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 10:46:00.231909 11925 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:46:00.238988 11925 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:46:00.262728 12568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.251646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:41653 (local address 127.0.0.1:40388)
0806 10:46:00.253756 (+ 2110us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.253778 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:00.253890 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:00.254927 (+ 1037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:00.254933 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:00.254957 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:00.255316 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:00.255328 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.257277 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.257283 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:00.259820 (+ 2537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:00.259841 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.261761 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.261768 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:00.261970 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.262025 (+ 55us) client_negotiation.cc:769] Sending connection context
0806 10:46:00.262131 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 10:46:00.262349 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1965,"mutex_wait_us":2,"thread_start_us":324,"threads_started":1}
I20260806 10:46:00.263176 12177 heartbeater.cc:503] Master 127.16.45.126:45873 was elected leader, sending a full tablet report...
I20260806 10:46:00.263814 12569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.251548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:33617 (local address 127.0.0.1:54530)
0806 10:46:00.252415 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.252475 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:00.252666 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:00.254179 (+ 1513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:00.254187 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:00.254217 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:00.254686 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:00.254701 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.257729 (+ 3028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.257735 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:00.259915 (+ 2180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:00.259926 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.262955 (+ 3029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.262962 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:00.263174 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.263206 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 10:46:00.263285 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 10:46:00.263435 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"mutex_wait_us":25,"thread_start_us":1422,"threads_started":1}
I20260806 10:46:00.264482 12570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.251783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54530 (local address 127.16.45.66:33617)
0806 10:46:00.253497 (+ 1714us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:00.253505 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:00.253536 (+ 31us) server_negotiation.cc:407] Connection header received
0806 10:46:00.253647 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:00.253655 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:00.253948 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:00.254164 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:00.254892 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.257579 (+ 2687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.261303 (+ 3724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.262745 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.263621 (+ 876us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.263881 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:00.263983 (+ 102us) server_negotiation.cc:299] Negotiation successful
0806 10:46:00.264152 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1561,"thread_start_us":1449,"threads_started":1}
I20260806 10:46:00.264732 12573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.252203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40388 (local address 127.16.45.65:41653)
0806 10:46:00.254352 (+ 2149us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:00.254360 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:00.254387 (+ 27us) server_negotiation.cc:407] Connection header received
0806 10:46:00.254478 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:00.254486 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:00.254717 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:00.255512 (+ 795us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:00.255728 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.257136 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.260122 (+ 2986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.261543 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.263876 (+ 2333us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.264138 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:00.264216 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 10:46:00.264382 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1950,"thread_start_us":2128,"threads_started":1}
I20260806 10:46:00.268666 12279 tablet_service.cc:1467] Processing CreateTablet for tablet 93dd5d4ce1344a6186150963c4e9fb12 (DEFAULT_TABLE table=test-table [id=41d577a08605476aa9ca9b08e0d51cbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:46:00.268671 12088 tablet_service.cc:1467] Processing CreateTablet for tablet 93dd5d4ce1344a6186150963c4e9fb12 (DEFAULT_TABLE table=test-table [id=41d577a08605476aa9ca9b08e0d51cbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:46:00.270155 12088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93dd5d4ce1344a6186150963c4e9fb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:00.270166 12279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93dd5d4ce1344a6186150963c4e9fb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:00.270908 12576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.254033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32882 (local address 127.16.45.67:39513)
0806 10:46:00.262981 (+ 8948us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:00.262988 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:00.264302 (+ 1314us) server_negotiation.cc:407] Connection header received
0806 10:46:00.264412 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:00.264421 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:00.264691 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:00.265526 (+ 835us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:00.265801 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.267172 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.268842 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.269798 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.269919 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.270181 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:00.270409 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 10:46:00.270574 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8781,"thread_start_us":8606,"threads_started":1}
I20260806 10:46:00.271311 12575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.253428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:39513 (local address 127.0.0.1:32882)
0806 10:46:00.263719 (+ 10291us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.263738 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:00.263869 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:00.264912 (+ 1043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:00.264918 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:00.264946 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:00.265317 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:00.265330 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.267310 (+ 1980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.267316 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:00.268658 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:00.268671 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.269983 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.269990 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:00.270167 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.270197 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 10:46:00.270282 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 10:46:00.270446 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9955,"thread_start_us":9807,"threads_started":1}
I20260806 10:46:00.275353 12463 tablet_service.cc:1467] Processing CreateTablet for tablet 93dd5d4ce1344a6186150963c4e9fb12 (DEFAULT_TABLE table=test-table [id=41d577a08605476aa9ca9b08e0d51cbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:46:00.278543 12463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93dd5d4ce1344a6186150963c4e9fb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:00.285391 12578 tablet_bootstrap.cc:492] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef: Bootstrap starting.
I20260806 10:46:00.287495 12580 tablet_bootstrap.cc:492] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c: Bootstrap starting.
I20260806 10:46:00.289227 12578 tablet_bootstrap.cc:654] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:00.290563 12578 log.cc:824] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:00.291473 12580 tablet_bootstrap.cc:654] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:00.292603 12580 log.cc:824] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:00.293804 12578 tablet_bootstrap.cc:492] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef: No bootstrap required, opened a new log
I20260806 10:46:00.294157 12578 ts_tablet_manager.cc:1397] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260806 10:46:00.294726 12584 tablet_bootstrap.cc:492] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93: Bootstrap starting.
I20260806 10:46:00.296912 12580 tablet_bootstrap.cc:492] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c: No bootstrap required, opened a new log
I20260806 10:46:00.297194 12580 ts_tablet_manager.cc:1397] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260806 10:46:00.298759 12584 tablet_bootstrap.cc:654] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:00.299993 12584 log.cc:824] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:00.302193 12578 raft_consensus.cc:348] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f8b5937a18047e891563c3d2039c16c" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33617 } } peers { permanent_uuid: "5072c31afd5149908d6de438afc4deef" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 41653 } } peers { permanent_uuid: "7398f64fc1c147aeb3e21ee3eb857d93" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39513 } }
I20260806 10:46:00.302734 12578 raft_consensus.cc:374] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:00.302829 12578 raft_consensus.cc:729] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5072c31afd5149908d6de438afc4deef, State: Initialized, Role: FOLLOWER
I20260806 10:46:00.303222 12584 tablet_bootstrap.cc:492] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93: No bootstrap required, opened a new log
I20260806 10:46:00.303558 12584 ts_tablet_manager.cc:1397] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260806 10:46:00.303470 12578 consensus_queue.cc:260] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f8b5937a18047e891563c3d2039c16c" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33617 } } peers { permanent_uuid: "5072c31afd5149908d6de438afc4deef" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 41653 } } peers { permanent_uuid: "7398f64fc1c147aeb3e21ee3eb857d93" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39513 } }
I20260806 10:46:00.305251 12578 ts_tablet_manager.cc:1428] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260806 10:46:00.307365 12580 raft_consensus.cc:348] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f8b5937a18047e891563c3d2039c16c" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33617 } } peers { permanent_uuid: "5072c31afd5149908d6de438afc4deef" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 41653 } } peers { permanent_uuid: "7398f64fc1c147aeb3e21ee3eb857d93" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39513 } }
I20260806 10:46:00.307857 12580 raft_consensus.cc:374] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:00.307961 12580 raft_consensus.cc:729] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f8b5937a18047e891563c3d2039c16c, State: Initialized, Role: FOLLOWER
I20260806 10:46:00.308573 12580 consensus_queue.cc:260] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f8b5937a18047e891563c3d2039c16c" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33617 } } peers { permanent_uuid: "5072c31afd5149908d6de438afc4deef" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 41653 } } peers { permanent_uuid: "7398f64fc1c147aeb3e21ee3eb857d93" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39513 } }
I20260806 10:46:00.309938 12378 heartbeater.cc:503] Master 127.16.45.126:45873 was elected leader, sending a full tablet report...
I20260806 10:46:00.310460 12580 ts_tablet_manager.cc:1428] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c: Time spent starting tablet: real 0.013s user 0.003s sys 0.010s
I20260806 10:46:00.313242 12584 raft_consensus.cc:348] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f8b5937a18047e891563c3d2039c16c" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33617 } } peers { permanent_uuid: "5072c31afd5149908d6de438afc4deef" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 41653 } } peers { permanent_uuid: "7398f64fc1c147aeb3e21ee3eb857d93" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39513 } }
I20260806 10:46:00.313612 12584 raft_consensus.cc:374] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:00.313697 12584 raft_consensus.cc:729] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7398f64fc1c147aeb3e21ee3eb857d93, State: Initialized, Role: FOLLOWER
I20260806 10:46:00.314254 12584 consensus_queue.cc:260] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f8b5937a18047e891563c3d2039c16c" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33617 } } peers { permanent_uuid: "5072c31afd5149908d6de438afc4deef" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 41653 } } peers { permanent_uuid: "7398f64fc1c147aeb3e21ee3eb857d93" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39513 } }
I20260806 10:46:00.315325 12554 heartbeater.cc:503] Master 127.16.45.126:45873 was elected leader, sending a full tablet report...
I20260806 10:46:00.315951 12584 ts_tablet_manager.cc:1428] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260806 10:46:00.343777 12586 raft_consensus.cc:482] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:46:00.344076 12586 raft_consensus.cc:504] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f8b5937a18047e891563c3d2039c16c" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33617 } } peers { permanent_uuid: "5072c31afd5149908d6de438afc4deef" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 41653 } } peers { permanent_uuid: "7398f64fc1c147aeb3e21ee3eb857d93" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39513 } }
I20260806 10:46:00.345752 12586 leader_election.cc:288] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f8b5937a18047e891563c3d2039c16c (127.16.45.66:33617), 7398f64fc1c147aeb3e21ee3eb857d93 (127.16.45.67:39513)
I20260806 10:46:00.353191 12570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.346148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:47033 (local address 127.16.45.66:33617)
0806 10:46:00.346396 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:00.346403 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:00.346792 (+ 389us) server_negotiation.cc:407] Connection header received
0806 10:46:00.347041 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:00.347048 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:00.347144 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:00.347253 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:00.347904 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.348825 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.351373 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.352202 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.352318 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.352367 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:00.352788 (+ 421us) server_negotiation.cc:299] Negotiation successful
0806 10:46:00.352929 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 10:46:00.353251 12590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.346038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:33617 (local address 127.16.45.65:47033)
0806 10:46:00.346670 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.346687 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:00.346864 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:00.347345 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:00.347350 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:00.347377 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:00.347779 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:00.347789 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.348955 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.348958 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:00.351170 (+ 2212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:00.351185 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.352389 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.352396 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:00.352626 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.352651 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 10:46:00.352725 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 10:46:00.352856 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"mutex_wait_us":55,"thread_start_us":362,"threads_started":1}
I20260806 10:46:00.353322 12591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.346809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:39513 (local address 127.16.45.65:46431)
0806 10:46:00.347492 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.347509 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:00.347629 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:00.347910 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:00.347913 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:00.347935 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:00.348194 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:00.348201 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.349362 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.349368 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:00.351371 (+ 2003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:00.351387 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.352531 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.352536 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:00.352733 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.352785 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 10:46:00.352867 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 10:46:00.352979 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"mutex_wait_us":37,"thread_start_us":299,"threads_started":1}
I20260806 10:46:00.353250 12576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.347053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:46431 (local address 127.16.45.67:39513)
0806 10:46:00.347252 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:00.347257 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:00.347602 (+ 345us) server_negotiation.cc:407] Connection header received
0806 10:46:00.347738 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:00.347742 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:00.347797 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:00.347876 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:00.348333 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.349230 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.351542 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.352330 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.352496 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.352561 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:00.352908 (+ 347us) server_negotiation.cc:299] Negotiation successful
0806 10:46:00.353031 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 10:46:00.354390 12313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93dd5d4ce1344a6186150963c4e9fb12" candidate_uuid: "5072c31afd5149908d6de438afc4deef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f8b5937a18047e891563c3d2039c16c" is_pre_election: true
I20260806 10:46:00.354884 12313 raft_consensus.cc:2454] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5072c31afd5149908d6de438afc4deef in term 0.
I20260806 10:46:00.354810 12488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93dd5d4ce1344a6186150963c4e9fb12" candidate_uuid: "5072c31afd5149908d6de438afc4deef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7398f64fc1c147aeb3e21ee3eb857d93" is_pre_election: true
I20260806 10:46:00.355399 12488 raft_consensus.cc:2454] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5072c31afd5149908d6de438afc4deef in term 0.
I20260806 10:46:00.355508 12026 leader_election.cc:302] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5072c31afd5149908d6de438afc4deef, 6f8b5937a18047e891563c3d2039c16c; no voters:
I20260806 10:46:00.355888 12586 raft_consensus.cc:2781] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:46:00.356118 12586 raft_consensus.cc:482] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:46:00.356282 12586 raft_consensus.cc:3037] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:00.358492 12586 raft_consensus.cc:504] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f8b5937a18047e891563c3d2039c16c" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33617 } } peers { permanent_uuid: "5072c31afd5149908d6de438afc4deef" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 41653 } } peers { permanent_uuid: "7398f64fc1c147aeb3e21ee3eb857d93" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39513 } }
I20260806 10:46:00.359050 12586 leader_election.cc:288] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [CANDIDATE]: Term 1 election: Requested vote from peers 6f8b5937a18047e891563c3d2039c16c (127.16.45.66:33617), 7398f64fc1c147aeb3e21ee3eb857d93 (127.16.45.67:39513)
I20260806 10:46:00.359460 12313 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93dd5d4ce1344a6186150963c4e9fb12" candidate_uuid: "5072c31afd5149908d6de438afc4deef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f8b5937a18047e891563c3d2039c16c"
I20260806 10:46:00.359563 12488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93dd5d4ce1344a6186150963c4e9fb12" candidate_uuid: "5072c31afd5149908d6de438afc4deef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7398f64fc1c147aeb3e21ee3eb857d93"
I20260806 10:46:00.359630 12313 raft_consensus.cc:3037] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:00.359771 12488 raft_consensus.cc:3037] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:00.361836 12313 raft_consensus.cc:2454] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5072c31afd5149908d6de438afc4deef in term 1.
I20260806 10:46:00.361874 12488 raft_consensus.cc:2454] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5072c31afd5149908d6de438afc4deef in term 1.
I20260806 10:46:00.362210 12026 leader_election.cc:302] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5072c31afd5149908d6de438afc4deef, 6f8b5937a18047e891563c3d2039c16c; no voters:
I20260806 10:46:00.362507 12586 raft_consensus.cc:2781] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:00.362978 12586 raft_consensus.cc:686] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 1 LEADER]: Becoming Leader. State: Replica: 5072c31afd5149908d6de438afc4deef, State: Running, Role: LEADER
I20260806 10:46:00.363511 12586 consensus_queue.cc:237] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f8b5937a18047e891563c3d2039c16c" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33617 } } peers { permanent_uuid: "5072c31afd5149908d6de438afc4deef" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 41653 } } peers { permanent_uuid: "7398f64fc1c147aeb3e21ee3eb857d93" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39513 } }
I20260806 10:46:00.367877 11925 catalog_manager.cc:5495] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef reported cstate change: term changed from 0 to 1, leader changed from <none> to 5072c31afd5149908d6de438afc4deef (127.16.45.65). New cstate: current_term: 1 leader_uuid: "5072c31afd5149908d6de438afc4deef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f8b5937a18047e891563c3d2039c16c" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5072c31afd5149908d6de438afc4deef" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7398f64fc1c147aeb3e21ee3eb857d93" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39513 } health_report { overall_health: UNKNOWN } } }
I20260806 10:46:00.392014 12573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.386230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40390 (local address 127.16.45.65:41653)
0806 10:46:00.386478 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:00.386484 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:00.386507 (+ 23us) server_negotiation.cc:407] Connection header received
0806 10:46:00.386648 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:00.386653 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:00.386757 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:00.386904 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:00.387351 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.388150 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.389615 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.390073 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.390196 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.390864 (+ 668us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:00.391374 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:00.391560 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:00.391735 (+ 175us) server_negotiation.cc:299] Negotiation successful
0806 10:46:00.391780 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260806 10:46:00.400174 12313 raft_consensus.cc:1261] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c [term 1 FOLLOWER]: Refusing update from remote peer 5072c31afd5149908d6de438afc4deef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:46:00.400182 12488 raft_consensus.cc:1261] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93 [term 1 FOLLOWER]: Refusing update from remote peer 5072c31afd5149908d6de438afc4deef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:46:00.401082 12592 consensus_queue.cc:1035] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [LEADER]: Connected to new peer: Peer: permanent_uuid: "7398f64fc1c147aeb3e21ee3eb857d93" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 39513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:46:00.401522 12586 consensus_queue.cc:1035] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f8b5937a18047e891563c3d2039c16c" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 33617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:46:00.425971 11924 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:46:00.426304 11924 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:46:00.430414 11924 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ed0a7da70d64d549dd7e821aa645c67: Sending DeleteTablet for 3 replicas of tablet 93dd5d4ce1344a6186150963c4e9fb12
I20260806 10:46:00.431547 12088 tablet_service.cc:1514] Processing DeleteTablet for tablet 93dd5d4ce1344a6186150963c4e9fb12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:46:00 UTC) from {username='slave'} at 127.0.0.1:40388
I20260806 10:46:00.431735 12279 tablet_service.cc:1514] Processing DeleteTablet for tablet 93dd5d4ce1344a6186150963c4e9fb12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:46:00 UTC) from {username='slave'} at 127.0.0.1:54530
I20260806 10:46:00.432811 12463 tablet_service.cc:1514] Processing DeleteTablet for tablet 93dd5d4ce1344a6186150963c4e9fb12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:46:00 UTC) from {username='slave'} at 127.0.0.1:32882
I20260806 10:46:00.433185 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 12006
I20260806 10:46:00.447291 12612 tablet_replica.cc:330] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c: stopping tablet replica
I20260806 10:46:00.447965 12612 raft_consensus.cc:2229] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:46:00.448643 12612 raft_consensus.cc:2258] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:46:00.449569 12610 tablet_replica.cc:330] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef: stopping tablet replica
I20260806 10:46:00.450055 12610 raft_consensus.cc:2229] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:46:00.452414 12612 ts_tablet_manager.cc:1905] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:46:00.456148 12573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.435191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40402 (local address 127.16.45.65:41653)
0806 10:46:00.435385 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:00.435392 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:00.438827 (+ 3435us) server_negotiation.cc:407] Connection header received
0806 10:46:00.439144 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:00.439152 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:00.439301 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:00.439391 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:00.440203 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.441598 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.449395 (+ 7797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.450185 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.450363 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.454132 (+ 3769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:00.454145 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:00.454165 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:00.455078 (+ 913us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:00.455153 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:00.455184 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:00.455282 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:00.455577 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 10:46:00.455711 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 10:46:00.458777 12610 raft_consensus.cc:2258] T 93dd5d4ce1344a6186150963c4e9fb12 P 5072c31afd5149908d6de438afc4deef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:46:00.459014 12171 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:00.459777 12613 tablet_replica.cc:330] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93: stopping tablet replica
I20260806 10:46:00.460270 12613 raft_consensus.cc:2229] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:46:00.460845 12613 raft_consensus.cc:2258] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:46:00.463096 12613 ts_tablet_manager.cc:1905] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:46:00.463462 12612 ts_tablet_manager.cc:1918] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:46:00.463649 12612 log.cc:1196] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/93dd5d4ce1344a6186150963c4e9fb12
I20260806 10:46:00.464381 12612 ts_tablet_manager.cc:1939] T 93dd5d4ce1344a6186150963c4e9fb12 P 6f8b5937a18047e891563c3d2039c16c: Deleting consensus metadata
I20260806 10:46:00.466801 11906 catalog_manager.cc:4841] TS 6f8b5937a18047e891563c3d2039c16c (127.16.45.66:33617): tablet 93dd5d4ce1344a6186150963c4e9fb12 (table test-table [id=41d577a08605476aa9ca9b08e0d51cbb]) successfully deleted
I20260806 10:46:00.469872 12613 ts_tablet_manager.cc:1918] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:46:00.470021 12613 log.cc:1196] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/93dd5d4ce1344a6186150963c4e9fb12
I20260806 10:46:00.470546 12613 ts_tablet_manager.cc:1939] T 93dd5d4ce1344a6186150963c4e9fb12 P 7398f64fc1c147aeb3e21ee3eb857d93: Deleting consensus metadata
I20260806 10:46:00.472170 11906 catalog_manager.cc:4841] TS 7398f64fc1c147aeb3e21ee3eb857d93 (127.16.45.67:39513): tablet 93dd5d4ce1344a6186150963c4e9fb12 (table test-table [id=41d577a08605476aa9ca9b08e0d51cbb]) successfully deleted
I20260806 10:46:00.557493 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 12006
I20260806 10:46:00.577943 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 12183
W20260806 10:46:00.578130 11907 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.45.65:41653 (error 108)
I20260806 10:46:00.580535 12575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.580067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:41653 (local address 127.0.0.1:40414)
0806 10:46:00.580265 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.580384 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:41653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 10:46:00.580760 11907 catalog_manager.cc:4584] TS 5072c31afd5149908d6de438afc4deef (127.16.45.65:41653): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 93dd5d4ce1344a6186150963c4e9fb12: Network error: Client connection negotiation failed: client connection to 127.16.45.65:41653: connect: Connection refused (error 111)
I20260806 10:46:00.585067 12570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.578856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54536 (local address 127.16.45.66:33617)
0806 10:46:00.579037 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:00.579043 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:00.579130 (+ 87us) server_negotiation.cc:407] Connection header received
0806 10:46:00.579334 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:00.579340 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:00.579458 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:00.579547 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:00.579970 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.580823 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.582080 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.582573 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.582682 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.583700 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:00.583708 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:00.583722 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:00.584288 (+ 566us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:00.584336 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:00.584395 (+ 59us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:00.584506 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:00.584630 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 10:46:00.584741 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 10:46:00.585711 12367 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:00.634573 12575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.634048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:41653 (local address 127.0.0.1:40426)
0806 10:46:00.634273 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.634402 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:41653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260806 10:46:00.635671 12575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.635324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:41653 (local address 127.0.0.1:40428)
0806 10:46:00.635460 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.635537 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:41653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 10:46:00.681959 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 12183
I20260806 10:46:00.696309 12575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.695706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:41653 (local address 127.0.0.1:40430)
0806 10:46:00.695979 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.696093 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:41653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 10:46:00.697517 12575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.697118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:41653 (local address 127.0.0.1:40432)
0806 10:46:00.697272 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.697359 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:41653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 10:46:00.703701 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 12382
I20260806 10:46:00.710608 12576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.704523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32886 (local address 127.16.45.67:39513)
0806 10:46:00.704705 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:00.704711 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:00.704731 (+ 20us) server_negotiation.cc:407] Connection header received
0806 10:46:00.704889 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:00.704895 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:00.705003 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:00.705102 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:00.705528 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.706278 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.707590 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:00.708068 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:00.708179 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:00.709180 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:00.709189 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:00.709204 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:00.709778 (+ 574us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:00.709847 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:00.709868 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:00.710005 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:00.710103 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 10:46:00.710214 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 10:46:00.711248 12549 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:00.777962 12575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.777381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:41653 (local address 127.0.0.1:40448)
0806 10:46:00.777632 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.777759 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:41653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260806 10:46:00.779302 12575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:00.778807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:41653 (local address 127.0.0.1:40462)
0806 10:46:00.779037 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:00.779164 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.65:41653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260806 10:46:00.798671 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 12382
I20260806 10:46:00.818621 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 11884
I20260806 10:46:00.819734 11970 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:00.929417 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 11884
2026-08-06T10:46:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2789 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:01 dist-test-slave-fgb3 krb5kdc[12623](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:01 dist-test-slave-fgb3 krb5kdc[12623](info): set up 2 sockets
Aug 06 10:46:01 dist-test-slave-fgb3 krb5kdc[12623](info): commencing operation
krb5kdc: starting...
W20260806 10:46:02.157812 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:02 dist-test-slave-fgb3 krb5kdc[12623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:46:02.465178 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:46505
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:45131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:46505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:02.803841 12638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:02.804162 12638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:02.804306 12638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:02.811546 12638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:02.811656 12638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:02.811736 12638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:02.811817 12638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:02.811877 12638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:02.821660 12638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:46505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:46505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:02.822974 12638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:02.824259 12638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:02.835780 12648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:02.835960 12651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:02.835997 12649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:02.836894 12638 server_base.cc:1034] running on GCE node
I20260806 10:46:02.837702 12638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:02.839226 12638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:02.840435 12638 hybrid_clock.cc:648] HybridClock initialized: now 1786013162840392 us; error 35 us; skew 500 ppm
I20260806 10:46:02.840783 12638 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:02 dist-test-slave-fgb3 krb5kdc[12623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013162, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:02.847069 12638 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:46:02.848649 12638 webserver.cc:460] Webserver started at http://127.16.45.126:38759/ using document root <none> and password file <none>
I20260806 10:46:02.849335 12638 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:02.849447 12638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:02.849740 12638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:02.852753 12638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "5c6cfb8d546e432a928cfc5743ab40ea"
format_stamp: "Formatted at 2026-08-06 10:46:02 on dist-test-slave-fgb3"
server_key: "dd872d20383da83a98a1e46c625d6f5b"
server_key_iv: "c415fefd29bb032f06d10c923694500c"
server_key_version: "encryptionkey@0"
I20260806 10:46:02.853497 12638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "5c6cfb8d546e432a928cfc5743ab40ea"
format_stamp: "Formatted at 2026-08-06 10:46:02 on dist-test-slave-fgb3"
server_key: "dd872d20383da83a98a1e46c625d6f5b"
server_key_iv: "c415fefd29bb032f06d10c923694500c"
server_key_version: "encryptionkey@0"
I20260806 10:46:02.858661 12638 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260806 10:46:02.862102 12660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:02.863394 12638 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:46:02.863560 12638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "5c6cfb8d546e432a928cfc5743ab40ea"
format_stamp: "Formatted at 2026-08-06 10:46:02 on dist-test-slave-fgb3"
server_key: "dd872d20383da83a98a1e46c625d6f5b"
server_key_iv: "c415fefd29bb032f06d10c923694500c"
server_key_version: "encryptionkey@0"
I20260806 10:46:02.863745 12638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:02.878389 12638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:02.882418 12638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:02.882691 12638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:02.900909 12638 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:46505
I20260806 10:46:02.900933 12738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:46505 every 8 connection(s)
I20260806 10:46:02.902288 12638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:02.905185 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 12638
I20260806 10:46:02.905371 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:02.905920 16565 external_mini_cluster.cc:1428] Setting key f7ad070a12178210b28bce4648774571
I20260806 10:46:02.906757 12739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:02.919363 12739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea: Bootstrap starting.
Aug 06 10:46:02 dist-test-slave-fgb3 krb5kdc[12623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:46:02.922926 12739 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:02.924059 12739 log.cc:824] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:02.927031 12739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea: No bootstrap required, opened a new log
I20260806 10:46:02.928114 12743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:02.907977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37650 (local address 127.16.45.126:46505)
0806 10:46:02.908783 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:02.908795 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:02.908847 (+ 52us) server_negotiation.cc:407] Connection header received
0806 10:46:02.910490 (+ 1643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:02.910513 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:02.910919 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:02.911290 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:02.912861 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:02.914160 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:02.915488 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:02.916168 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:02.916345 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:02.920659 (+ 4314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:02.920667 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:02.920681 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:02.920724 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:02.923959 (+ 3235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:02.924784 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:02.924791 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:02.924800 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:02.924983 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:02.925361 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:02.925365 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:02.925367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:02.925916 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:02.926209 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:02.926673 (+ 464us) server_negotiation.cc:299] Negotiation successful
0806 10:46:02.927112 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":359,"threads_started":1}
I20260806 10:46:02.934656 12739 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6cfb8d546e432a928cfc5743ab40ea" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46505 } }
I20260806 10:46:02.935012 12739 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:02.935119 12739 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c6cfb8d546e432a928cfc5743ab40ea, State: Initialized, Role: FOLLOWER
I20260806 10:46:02.935619 12739 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6cfb8d546e432a928cfc5743ab40ea" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46505 } }
I20260806 10:46:02.935832 12739 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:02.935931 12739 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:02.936055 12739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:02.938613 12739 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6cfb8d546e432a928cfc5743ab40ea" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46505 } }
I20260806 10:46:02.939086 12739 leader_election.cc:302] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c6cfb8d546e432a928cfc5743ab40ea; no voters:
I20260806 10:46:02.939654 12739 leader_election.cc:288] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:02.939785 12748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:02.940428 12748 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [term 1 LEADER]: Becoming Leader. State: Replica: 5c6cfb8d546e432a928cfc5743ab40ea, State: Running, Role: LEADER
I20260806 10:46:02.940989 12748 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6cfb8d546e432a928cfc5743ab40ea" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46505 } }
I20260806 10:46:02.941895 12739 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:02.943759 12749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c6cfb8d546e432a928cfc5743ab40ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6cfb8d546e432a928cfc5743ab40ea" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46505 } } }
I20260806 10:46:02.944169 12749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:02.946573 12756 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:02.946386 12750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c6cfb8d546e432a928cfc5743ab40ea. Latest consensus state: current_term: 1 leader_uuid: "5c6cfb8d546e432a928cfc5743ab40ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6cfb8d546e432a928cfc5743ab40ea" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46505 } } }
I20260806 10:46:02.946734 12750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:02.952301 12756 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:02.961862 12756 catalog_manager.cc:1347] Generated new cluster ID: 847da774e13c4d35880f0501ab068872
I20260806 10:46:02.961985 12756 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:02.994624 12756 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:02.995995 12756 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:03.003865 12756 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea: Generated new TSK 0
I20260806 10:46:03.004745 12756 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
Entry for principal kudu/127.16.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab.
I20260806 10:46:03.089622 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:46505
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:45131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:03.448446 12774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:03.448741 12774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:03.448868 12774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:03.456204 12774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:03.456333 12774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:03.456488 12774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:46:03.466420 12774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.65.keytab
--principal=kudu/127.16.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:46505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:03.467800 12774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:03.469154 12774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:03.481997 12783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:03.482072 12785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:03.482036 12782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:03.482857 12774 server_base.cc:1034] running on GCE node
I20260806 10:46:03.483418 12774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:03.484314 12774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:03.485518 12774 hybrid_clock.cc:648] HybridClock initialized: now 1786013163485461 us; error 49 us; skew 500 ppm
I20260806 10:46:03.485818 12774 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:03 dist-test-slave-fgb3 krb5kdc[12623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013163, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:03.488844 12774 init.cc:377] Logged in from keytab as kudu/127.16.45.65@KRBTEST.COM (short username kudu)
I20260806 10:46:03.490285 12774 webserver.cc:460] Webserver started at http://127.16.45.65:41951/ using document root <none> and password file <none>
I20260806 10:46:03.490990 12774 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:03.491112 12774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:03.491422 12774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:03.494288 12774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "acce42bb90624fc2a82a05e60473f40b"
format_stamp: "Formatted at 2026-08-06 10:46:03 on dist-test-slave-fgb3"
server_key: "72bea7ceb1cdb3f6c0a94832c3d7b90e"
server_key_iv: "15d5854a57158ffb467aae52fd273737"
server_key_version: "encryptionkey@0"
I20260806 10:46:03.495117 12774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "acce42bb90624fc2a82a05e60473f40b"
format_stamp: "Formatted at 2026-08-06 10:46:03 on dist-test-slave-fgb3"
server_key: "72bea7ceb1cdb3f6c0a94832c3d7b90e"
server_key_iv: "15d5854a57158ffb467aae52fd273737"
server_key_version: "encryptionkey@0"
I20260806 10:46:03.500362 12774 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:46:03.504048 12797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:03.505494 12774 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 10:46:03.505666 12774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "acce42bb90624fc2a82a05e60473f40b"
format_stamp: "Formatted at 2026-08-06 10:46:03 on dist-test-slave-fgb3"
server_key: "72bea7ceb1cdb3f6c0a94832c3d7b90e"
server_key_iv: "15d5854a57158ffb467aae52fd273737"
server_key_version: "encryptionkey@0"
I20260806 10:46:03.505868 12774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:03.527499 12774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:03.531430 12774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:03.531685 12774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:03.532640 12774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:46:03.533921 12774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:46:03.533999 12774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:03.534121 12774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:46:03.534175 12774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:03.565707 12774 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:33679
I20260806 10:46:03.565755 12962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:33679 every 8 connection(s)
I20260806 10:46:03.567027 12774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:46:03.576494 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 12774
I20260806 10:46:03.576670 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:46:03.577104 16565 external_mini_cluster.cc:1428] Setting key 58948de49be799dcea836218e9fd9324
Aug 06 10:46:03 dist-test-slave-fgb3 krb5kdc[12623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013163, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.65@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:46:03.586196 12966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:03.569596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:51101 (local address 127.16.45.126:46505)
0806 10:46:03.570014 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:03.570018 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:03.570943 (+ 925us) server_negotiation.cc:407] Connection header received
0806 10:46:03.572751 (+ 1808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:03.572757 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:03.572838 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:03.572937 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:03.574509 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:03.575213 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:03.576790 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:03.577182 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:03.577334 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:03.580768 (+ 3434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:03.580780 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:03.580783 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:03.580815 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:03.583234 (+ 2419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:03.583926 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:03.583931 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:03.583933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:03.584054 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:03.584479 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:03.584482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:03.584485 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:03.584753 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:03.584894 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:03.585609 (+ 715us) server_negotiation.cc:299] Negotiation successful
0806 10:46:03.585853 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":206,"threads_started":1}
I20260806 10:46:03.587132 12967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:03.570067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:46505 (local address 127.16.45.65:51101)
0806 10:46:03.570781 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:03.570819 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:03.572486 (+ 1667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:03.573179 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:03.573187 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:03.573681 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:03.574262 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:03.574283 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:03.575373 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:03.575377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:03.576654 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:03.576669 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:03.577426 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:03.577434 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:03.577651 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:03.578358 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:03.578389 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:03.580564 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:03.583367 (+ 2803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:03.583376 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:03.583393 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:03.583806 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:03.584156 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:03.584161 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:03.584165 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:03.584364 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:03.584886 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:03.584894 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:03.585223 (+ 329us) client_negotiation.cc:769] Sending connection context
0806 10:46:03.585466 (+ 243us) client_negotiation.cc:240] Negotiation successful
0806 10:46:03.585990 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":279,"threads_started":1}
I20260806 10:46:03.588634 12963 heartbeater.cc:347] Connected to a master server at 127.16.45.126:46505
I20260806 10:46:03.588913 12963 heartbeater.cc:464] Registering TS with master...
I20260806 10:46:03.589627 12963 heartbeater.cc:511] Master 127.16.45.126:46505 requested a full tablet report, sending...
I20260806 10:46:03.591931 12688 ts_manager.cc:194] Registered new tserver with Master: acce42bb90624fc2a82a05e60473f40b (127.16.45.65:33679)
I20260806 10:46:03.593334 12688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.65@KRBTEST.COM'} at 127.16.45.65:51101
WARNING: no policy specified for kudu/127.16.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
Entry for principal kudu/127.16.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab.
I20260806 10:46:03.642102 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:46505
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:45131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:03.975623 12971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:03.975914 12971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:03.976009 12971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:03.983218 12971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:03.983319 12971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:03.983450 12971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:46:03.992966 12971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.66.keytab
--principal=kudu/127.16.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:46505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:03.994200 12971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:03.995509 12971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:04.008739 12976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:04.008709 12979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:04.008675 12977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:04.009996 12971 server_base.cc:1034] running on GCE node
I20260806 10:46:04.010692 12971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:04.011668 12971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:04.012883 12971 hybrid_clock.cc:648] HybridClock initialized: now 1786013164012833 us; error 40 us; skew 500 ppm
I20260806 10:46:04.013214 12971 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:04 dist-test-slave-fgb3 krb5kdc[12623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013164, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:04.016453 12971 init.cc:377] Logged in from keytab as kudu/127.16.45.66@KRBTEST.COM (short username kudu)
I20260806 10:46:04.017939 12971 webserver.cc:460] Webserver started at http://127.16.45.66:35871/ using document root <none> and password file <none>
I20260806 10:46:04.018682 12971 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:04.018798 12971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:04.019112 12971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:04.022202 12971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "a0352cf5f9d2432ba2a364733c08ddbb"
format_stamp: "Formatted at 2026-08-06 10:46:04 on dist-test-slave-fgb3"
server_key: "1107c5d7aa999a4580912e48621a28e2"
server_key_iv: "897529761650953fbfa1e1ea3994be5e"
server_key_version: "encryptionkey@0"
I20260806 10:46:04.023015 12971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "a0352cf5f9d2432ba2a364733c08ddbb"
format_stamp: "Formatted at 2026-08-06 10:46:04 on dist-test-slave-fgb3"
server_key: "1107c5d7aa999a4580912e48621a28e2"
server_key_iv: "897529761650953fbfa1e1ea3994be5e"
server_key_version: "encryptionkey@0"
I20260806 10:46:04.028419 12971 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 10:46:04.032233 12987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:04.033813 12971 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:46:04.033999 12971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "a0352cf5f9d2432ba2a364733c08ddbb"
format_stamp: "Formatted at 2026-08-06 10:46:04 on dist-test-slave-fgb3"
server_key: "1107c5d7aa999a4580912e48621a28e2"
server_key_iv: "897529761650953fbfa1e1ea3994be5e"
server_key_version: "encryptionkey@0"
I20260806 10:46:04.034231 12971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:04.052219 12971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:04.057096 12971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:04.057478 12971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:04.058946 12971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:46:04.060511 12971 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:46:04.060590 12971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:04.060710 12971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:46:04.060770 12971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:04.091866 12971 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:46279
I20260806 10:46:04.091917 13134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:46279 every 8 connection(s)
I20260806 10:46:04.093209 12971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:46:04.103543 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 12971
I20260806 10:46:04.103739 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:46:04.104286 16565 external_mini_cluster.cc:1428] Setting key 3b2deffd80b3b06faabb0462483002c8
Aug 06 10:46:04 dist-test-slave-fgb3 krb5kdc[12623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013164, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.66@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:46:04.114089 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.095752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:54117 (local address 127.16.45.126:46505)
0806 10:46:04.096234 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:04.096241 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:04.097254 (+ 1013us) server_negotiation.cc:407] Connection header received
0806 10:46:04.099152 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:04.099157 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:04.099229 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:04.099347 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:04.100814 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.101575 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.103159 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.103814 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.103948 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.107729 (+ 3781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:04.107735 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:04.107739 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:04.107780 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:04.110970 (+ 3190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:04.111720 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:04.111725 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:04.111729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:04.111880 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:04.112285 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:04.112290 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:04.112293 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:04.112623 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:04.112769 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:04.113499 (+ 730us) server_negotiation.cc:299] Negotiation successful
0806 10:46:04.113720 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":211,"threads_started":1}
I20260806 10:46:04.114954 13140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.096326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:46505 (local address 127.16.45.66:54117)
0806 10:46:04.097091 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:04.097129 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:04.098857 (+ 1728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:04.099549 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:04.099557 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:04.100083 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:04.100648 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.100666 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.101693 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.101697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.102998 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.103011 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.104036 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.104040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.104254 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.104999 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:04.105032 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:04.107483 (+ 2451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:04.111121 (+ 3638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:04.111128 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:04.111144 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:04.111592 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:04.111969 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:04.111972 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:04.111974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:04.112177 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:04.112746 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:04.112753 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:04.113104 (+ 351us) client_negotiation.cc:769] Sending connection context
0806 10:46:04.113370 (+ 266us) client_negotiation.cc:240] Negotiation successful
0806 10:46:04.113782 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":299,"threads_started":1}
I20260806 10:46:04.116489 13135 heartbeater.cc:347] Connected to a master server at 127.16.45.126:46505
I20260806 10:46:04.116801 13135 heartbeater.cc:464] Registering TS with master...
I20260806 10:46:04.117534 13135 heartbeater.cc:511] Master 127.16.45.126:46505 requested a full tablet report, sending...
I20260806 10:46:04.119082 12688 ts_manager.cc:194] Registered new tserver with Master: a0352cf5f9d2432ba2a364733c08ddbb (127.16.45.66:46279)
I20260806 10:46:04.120023 12688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.66@KRBTEST.COM'} at 127.16.45.66:54117
WARNING: no policy specified for kudu/127.16.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
Entry for principal kudu/127.16.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab.
I20260806 10:46:04.173887 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:46505
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:45131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:04.505081 13143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:04.505366 13143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:04.505470 13143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:04.512754 13143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:04.512866 13143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:04.512987 13143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:46:04.523252 13143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.67.keytab
--principal=kudu/127.16.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:46505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:04.524485 13143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:04.525733 13143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:04.538341 13149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:04.538255 13152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:04.538565 13150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:04.539283 13143 server_base.cc:1034] running on GCE node
I20260806 10:46:04.539932 13143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:04.540906 13143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:04.542107 13143 hybrid_clock.cc:648] HybridClock initialized: now 1786013164542052 us; error 46 us; skew 500 ppm
I20260806 10:46:04.542526 13143 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:04 dist-test-slave-fgb3 krb5kdc[12623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013164, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:04.545593 13143 init.cc:377] Logged in from keytab as kudu/127.16.45.67@KRBTEST.COM (short username kudu)
I20260806 10:46:04.547076 13143 webserver.cc:460] Webserver started at http://127.16.45.67:38437/ using document root <none> and password file <none>
I20260806 10:46:04.547801 13143 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:04.547925 13143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:04.548226 13143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:04.551249 13143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "3764fac3378441e6979750477912a3ff"
format_stamp: "Formatted at 2026-08-06 10:46:04 on dist-test-slave-fgb3"
server_key: "61dd74dea5885e90efee6260a778e35b"
server_key_iv: "1755bfbd06ae1fddaf31ccd5f17c96ff"
server_key_version: "encryptionkey@0"
I20260806 10:46:04.552014 13143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "3764fac3378441e6979750477912a3ff"
format_stamp: "Formatted at 2026-08-06 10:46:04 on dist-test-slave-fgb3"
server_key: "61dd74dea5885e90efee6260a778e35b"
server_key_iv: "1755bfbd06ae1fddaf31ccd5f17c96ff"
server_key_version: "encryptionkey@0"
I20260806 10:46:04.557099 13143 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260806 10:46:04.560391 13160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:04.561604 13143 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 10:46:04.561753 13143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "3764fac3378441e6979750477912a3ff"
format_stamp: "Formatted at 2026-08-06 10:46:04 on dist-test-slave-fgb3"
server_key: "61dd74dea5885e90efee6260a778e35b"
server_key_iv: "1755bfbd06ae1fddaf31ccd5f17c96ff"
server_key_version: "encryptionkey@0"
I20260806 10:46:04.561924 13143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:04.580962 13143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:04.584681 13143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:04.584936 13143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:04.585842 13143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:46:04.587222 13143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:46:04.587299 13143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:04.587424 13143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:46:04.587478 13143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:04.596263 12963 heartbeater.cc:503] Master 127.16.45.126:46505 was elected leader, sending a full tablet report...
I20260806 10:46:04.616950 13143 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:37347
I20260806 10:46:04.616984 13300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:37347 every 8 connection(s)
I20260806 10:46:04.618180 13143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:46:04.624111 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 13143
I20260806 10:46:04.624289 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:46:04.624748 16565 external_mini_cluster.cc:1428] Setting key 4bf75ef48fa274bac5c4484a8d52c971
Aug 06 10:46:04 dist-test-slave-fgb3 krb5kdc[12623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013164, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.67@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:46:04.637121 13305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.620638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:60413 (local address 127.16.45.126:46505)
0806 10:46:04.621073 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:04.621077 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:04.621971 (+ 894us) server_negotiation.cc:407] Connection header received
0806 10:46:04.623752 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:04.623758 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:04.623866 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:04.623989 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:04.625558 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.626493 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.627998 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.628414 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.628521 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.631792 (+ 3271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:04.631797 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:04.631800 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:04.631833 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:04.634254 (+ 2421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:04.634936 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:04.634942 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:04.634946 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:04.635061 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:04.635457 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:04.635462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:04.635466 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:04.635723 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:04.635859 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:04.636524 (+ 665us) server_negotiation.cc:299] Negotiation successful
0806 10:46:04.636739 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":192,"threads_started":1}
I20260806 10:46:04.638109 13306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.621141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:46505 (local address 127.16.45.67:60413)
0806 10:46:04.621799 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:04.621835 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:04.623493 (+ 1658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:04.624161 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:04.624168 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:04.624710 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:04.625385 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.625412 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.626637 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.626641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.627851 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.627864 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.628632 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.628639 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.628858 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.629454 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:04.629480 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:04.631595 (+ 2115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:04.634405 (+ 2810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:04.634414 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:04.634430 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:04.634826 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:04.635164 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:04.635169 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:04.635173 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:04.635351 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:04.635843 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:04.635851 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:04.636176 (+ 325us) client_negotiation.cc:769] Sending connection context
0806 10:46:04.636412 (+ 236us) client_negotiation.cc:240] Negotiation successful
0806 10:46:04.636927 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":250,"threads_started":1}
I20260806 10:46:04.639357 13302 heartbeater.cc:347] Connected to a master server at 127.16.45.126:46505
I20260806 10:46:04.639863 13302 heartbeater.cc:464] Registering TS with master...
I20260806 10:46:04.640556 13302 heartbeater.cc:511] Master 127.16.45.126:46505 requested a full tablet report, sending...
I20260806 10:46:04.641851 12688 ts_manager.cc:194] Registered new tserver with Master: 3764fac3378441e6979750477912a3ff (127.16.45.67:37347)
I20260806 10:46:04.642683 12688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.45.67@KRBTEST.COM'} at 127.16.45.67:60413
I20260806 10:46:04.651937 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:46:04.668352 13305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.656029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59074 (local address 127.16.45.126:46505)
0806 10:46:04.656195 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:04.656201 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:04.656609 (+ 408us) server_negotiation.cc:407] Connection header received
0806 10:46:04.656772 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:04.656776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:04.656852 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:04.656941 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:04.658389 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.659126 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.660374 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.660760 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.660868 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.663203 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:04.663208 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:04.663211 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:04.663245 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:04.665707 (+ 2462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:04.666351 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:04.666357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:04.666361 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:04.666484 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:04.666838 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:04.666844 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:04.666848 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:04.667191 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:04.667421 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:04.667781 (+ 360us) server_negotiation.cc:299] Negotiation successful
0806 10:46:04.668018 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 10:46:04.672259 12688 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:46:04.679214 12688 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:46:04.712618 13321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.691432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56370 (local address 127.16.45.66:46279)
0806 10:46:04.692384 (+ 952us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:04.692390 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:04.702460 (+ 10070us) server_negotiation.cc:407] Connection header received
0806 10:46:04.703763 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:04.703774 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:04.704090 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:04.704275 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:04.705347 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.707144 (+ 1797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.709773 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.711247 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.711376 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.711595 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:04.712091 (+ 496us) server_negotiation.cc:299] Negotiation successful
0806 10:46:04.712281 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":808,"thread_start_us":655,"threads_started":1}
I20260806 10:46:04.712725 13323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.691166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:46279 (local address 127.0.0.1:56370)
0806 10:46:04.702177 (+ 11011us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:04.702256 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:04.703450 (+ 1194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:04.704625 (+ 1175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:04.704633 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:04.704666 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:04.705109 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.705124 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.707361 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.707367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.709618 (+ 2251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.709629 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.711474 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.711485 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.711695 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.711857 (+ 162us) client_negotiation.cc:769] Sending connection context
0806 10:46:04.712035 (+ 178us) client_negotiation.cc:240] Negotiation successful
0806 10:46:04.712250 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10649,"mutex_wait_us":61,"thread_start_us":16084,"threads_started":1}
I20260806 10:46:04.716509 13325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.692834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58134 (local address 127.16.45.67:37347)
0806 10:46:04.708444 (+ 15610us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:04.708452 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:04.708482 (+ 30us) server_negotiation.cc:407] Connection header received
0806 10:46:04.708573 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:04.708579 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:04.708807 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:04.709026 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:04.709811 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.711667 (+ 1856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.713925 (+ 2258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.715180 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.715304 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.715541 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:04.716001 (+ 460us) server_negotiation.cc:299] Negotiation successful
0806 10:46:04.716161 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15441,"thread_start_us":15281,"threads_started":1}
I20260806 10:46:04.716599 13320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.691358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:33679 (local address 127.0.0.1:44660)
0806 10:46:04.703205 (+ 11847us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:04.703228 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:04.703440 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:04.708696 (+ 5256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:04.708701 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:04.708728 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:04.709187 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.709199 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.711252 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.711257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.713577 (+ 2320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.713592 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.715747 (+ 2155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.715755 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.715924 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.715956 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 10:46:04.716045 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 10:46:04.716175 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11701,"mutex_wait_us":100,"thread_start_us":11537,"threads_started":1}
I20260806 10:46:04.716792 13324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.692518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44660 (local address 127.16.45.65:33679)
0806 10:46:04.708033 (+ 15515us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:04.708043 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:04.708075 (+ 32us) server_negotiation.cc:407] Connection header received
0806 10:46:04.708176 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:04.708183 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:04.708468 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:04.708683 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:04.709383 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.711091 (+ 1708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.713762 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.715185 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.715317 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.715542 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:04.716321 (+ 779us) server_negotiation.cc:299] Negotiation successful
0806 10:46:04.716487 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15349,"thread_start_us":15190,"threads_started":1}
I20260806 10:46:04.717173 13319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.692044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:37347 (local address 127.0.0.1:58134)
0806 10:46:04.707045 (+ 15001us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:04.707063 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:04.707172 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:04.709080 (+ 1908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:04.709084 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:04.709115 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:04.709576 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.709593 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.711776 (+ 2183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.711780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.713782 (+ 2002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.713796 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.715689 (+ 1893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.715693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.715825 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.715849 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 10:46:04.715927 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 10:46:04.716063 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14883,"thread_start_us":9585,"threads_started":1}
I20260806 10:46:04.717114 13052 tablet_service.cc:1467] Processing CreateTablet for tablet 6fe6207187d64c009e5e64a6b361d523 (DEFAULT_TABLE table=test-table [id=8f562a3329f04fbfafec2521f4cac28d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:46:04.718611 13052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fe6207187d64c009e5e64a6b361d523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:04.720471 12868 tablet_service.cc:1467] Processing CreateTablet for tablet 6fe6207187d64c009e5e64a6b361d523 (DEFAULT_TABLE table=test-table [id=8f562a3329f04fbfafec2521f4cac28d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:46:04.721156 13225 tablet_service.cc:1467] Processing CreateTablet for tablet 6fe6207187d64c009e5e64a6b361d523 (DEFAULT_TABLE table=test-table [id=8f562a3329f04fbfafec2521f4cac28d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:46:04.722031 12868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fe6207187d64c009e5e64a6b361d523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:04.722599 13225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fe6207187d64c009e5e64a6b361d523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:04.729593 13326 tablet_bootstrap.cc:492] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb: Bootstrap starting.
I20260806 10:46:04.732717 13326 tablet_bootstrap.cc:654] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:04.733834 13326 log.cc:824] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:04.736668 13326 tablet_bootstrap.cc:492] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb: No bootstrap required, opened a new log
I20260806 10:46:04.737051 13326 ts_tablet_manager.cc:1397] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20260806 10:46:04.737094 13328 tablet_bootstrap.cc:492] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff: Bootstrap starting.
I20260806 10:46:04.740831 13328 tablet_bootstrap.cc:654] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:04.741722 13329 tablet_bootstrap.cc:492] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b: Bootstrap starting.
I20260806 10:46:04.742179 13328 log.cc:824] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:04.744760 13329 tablet_bootstrap.cc:654] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:04.746052 13329 log.cc:824] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:04.748018 13326 raft_consensus.cc:348] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46279 } } peers { permanent_uuid: "acce42bb90624fc2a82a05e60473f40b" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 33679 } } peers { permanent_uuid: "3764fac3378441e6979750477912a3ff" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37347 } }
I20260806 10:46:04.748376 13326 raft_consensus.cc:374] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:04.748528 13326 raft_consensus.cc:729] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0352cf5f9d2432ba2a364733c08ddbb, State: Initialized, Role: FOLLOWER
I20260806 10:46:04.748657 13328 tablet_bootstrap.cc:492] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff: No bootstrap required, opened a new log
I20260806 10:46:04.748965 13328 ts_tablet_manager.cc:1397] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260806 10:46:04.749150 13329 tablet_bootstrap.cc:492] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b: No bootstrap required, opened a new log
I20260806 10:46:04.749130 13326 consensus_queue.cc:260] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46279 } } peers { permanent_uuid: "acce42bb90624fc2a82a05e60473f40b" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 33679 } } peers { permanent_uuid: "3764fac3378441e6979750477912a3ff" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37347 } }
I20260806 10:46:04.749413 13329 ts_tablet_manager.cc:1397] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 10:46:04.750255 13135 heartbeater.cc:503] Master 127.16.45.126:46505 was elected leader, sending a full tablet report...
I20260806 10:46:04.750905 13326 ts_tablet_manager.cc:1428] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260806 10:46:04.759836 13329 raft_consensus.cc:348] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46279 } } peers { permanent_uuid: "acce42bb90624fc2a82a05e60473f40b" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 33679 } } peers { permanent_uuid: "3764fac3378441e6979750477912a3ff" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37347 } }
I20260806 10:46:04.759757 13328 raft_consensus.cc:348] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46279 } } peers { permanent_uuid: "acce42bb90624fc2a82a05e60473f40b" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 33679 } } peers { permanent_uuid: "3764fac3378441e6979750477912a3ff" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37347 } }
I20260806 10:46:04.760277 13328 raft_consensus.cc:374] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:04.760267 13329 raft_consensus.cc:374] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:04.760380 13328 raft_consensus.cc:729] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3764fac3378441e6979750477912a3ff, State: Initialized, Role: FOLLOWER
I20260806 10:46:04.760388 13329 raft_consensus.cc:729] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acce42bb90624fc2a82a05e60473f40b, State: Initialized, Role: FOLLOWER
I20260806 10:46:04.761034 13328 consensus_queue.cc:260] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46279 } } peers { permanent_uuid: "acce42bb90624fc2a82a05e60473f40b" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 33679 } } peers { permanent_uuid: "3764fac3378441e6979750477912a3ff" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37347 } }
I20260806 10:46:04.761034 13329 consensus_queue.cc:260] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46279 } } peers { permanent_uuid: "acce42bb90624fc2a82a05e60473f40b" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 33679 } } peers { permanent_uuid: "3764fac3378441e6979750477912a3ff" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37347 } }
I20260806 10:46:04.762146 13302 heartbeater.cc:503] Master 127.16.45.126:46505 was elected leader, sending a full tablet report...
I20260806 10:46:04.763000 13328 ts_tablet_manager.cc:1428] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260806 10:46:04.763207 13329 ts_tablet_manager.cc:1428] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
W20260806 10:46:04.819370 12964 tablet.cc:2369] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:46:04.845270 13136 tablet.cc:2369] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:46:04.869742 13303 tablet.cc:2369] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:46:04.980115 13333 raft_consensus.cc:482] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:46:04.980402 13333 raft_consensus.cc:504] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46279 } } peers { permanent_uuid: "acce42bb90624fc2a82a05e60473f40b" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 33679 } } peers { permanent_uuid: "3764fac3378441e6979750477912a3ff" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37347 } }
I20260806 10:46:04.982118 13333 leader_election.cc:288] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acce42bb90624fc2a82a05e60473f40b (127.16.45.65:33679), 3764fac3378441e6979750477912a3ff (127.16.45.67:37347)
I20260806 10:46:04.988709 13324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.982689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:45125 (local address 127.16.45.65:33679)
0806 10:46:04.982914 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:04.982920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:04.983617 (+ 697us) server_negotiation.cc:407] Connection header received
0806 10:46:04.983795 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:04.983799 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:04.983858 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:04.983941 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:04.984545 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.985240 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.987060 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.987836 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.987989 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.988063 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:04.988351 (+ 288us) server_negotiation.cc:299] Negotiation successful
0806 10:46:04.988480 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 10:46:04.988739 13325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.982612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:45593 (local address 127.16.45.67:37347)
0806 10:46:04.982827 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:04.982833 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:04.983533 (+ 700us) server_negotiation.cc:407] Connection header received
0806 10:46:04.983730 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:04.983734 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:04.983794 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:04.983876 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:04.984455 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.985187 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.987068 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.987835 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.987980 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.988064 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:04.988381 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 10:46:04.988508 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 10:46:04.988894 13340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.982733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:33679 (local address 127.16.45.66:45125)
0806 10:46:04.983507 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:04.983524 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:04.983671 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:04.983966 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:04.983970 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:04.983997 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:04.984405 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.984413 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.985371 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.985386 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.986916 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.986928 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.988059 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.988066 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.988208 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.988232 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 10:46:04.988309 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 10:46:04.988441 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"mutex_wait_us":20,"thread_start_us":457,"threads_started":1}
I20260806 10:46:04.988921 13338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:04.982687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:37347 (local address 127.16.45.66:45593)
0806 10:46:04.983409 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:04.983428 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:04.983574 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:04.983913 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:04.983917 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:04.983941 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:04.984295 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.984308 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.985321 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.985331 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.986914 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:04.986927 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:04.988110 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:04.988115 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:04.988232 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:04.988255 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 10:46:04.988344 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 10:46:04.988473 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":18,"thread_start_us":327,"threads_started":1}
I20260806 10:46:04.989797 13250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe6207187d64c009e5e64a6b361d523" candidate_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3764fac3378441e6979750477912a3ff" is_pre_election: true
I20260806 10:46:04.989823 12898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe6207187d64c009e5e64a6b361d523" candidate_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acce42bb90624fc2a82a05e60473f40b" is_pre_election: true
I20260806 10:46:04.990268 13250 raft_consensus.cc:2454] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0352cf5f9d2432ba2a364733c08ddbb in term 0.
I20260806 10:46:04.990267 12898 raft_consensus.cc:2454] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0352cf5f9d2432ba2a364733c08ddbb in term 0.
I20260806 10:46:04.990912 12989 leader_election.cc:302] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0352cf5f9d2432ba2a364733c08ddbb, acce42bb90624fc2a82a05e60473f40b; no voters:
I20260806 10:46:04.991276 13333 raft_consensus.cc:2781] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:46:04.991405 13333 raft_consensus.cc:482] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:46:04.991500 13333 raft_consensus.cc:3037] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:04.993597 13333 raft_consensus.cc:504] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46279 } } peers { permanent_uuid: "acce42bb90624fc2a82a05e60473f40b" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 33679 } } peers { permanent_uuid: "3764fac3378441e6979750477912a3ff" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37347 } }
I20260806 10:46:04.994149 13333 leader_election.cc:288] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [CANDIDATE]: Term 1 election: Requested vote from peers acce42bb90624fc2a82a05e60473f40b (127.16.45.65:33679), 3764fac3378441e6979750477912a3ff (127.16.45.67:37347)
I20260806 10:46:04.994617 12898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe6207187d64c009e5e64a6b361d523" candidate_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acce42bb90624fc2a82a05e60473f40b"
I20260806 10:46:04.994617 13250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe6207187d64c009e5e64a6b361d523" candidate_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3764fac3378441e6979750477912a3ff"
I20260806 10:46:04.994825 12898 raft_consensus.cc:3037] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:04.994851 13250 raft_consensus.cc:3037] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:04.997936 13250 raft_consensus.cc:2454] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0352cf5f9d2432ba2a364733c08ddbb in term 1.
I20260806 10:46:04.997931 12898 raft_consensus.cc:2454] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0352cf5f9d2432ba2a364733c08ddbb in term 1.
I20260806 10:46:04.998356 12988 leader_election.cc:302] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3764fac3378441e6979750477912a3ff, a0352cf5f9d2432ba2a364733c08ddbb; no voters:
I20260806 10:46:04.998754 13333 raft_consensus.cc:2781] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:04.999217 13333 raft_consensus.cc:686] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 1 LEADER]: Becoming Leader. State: Replica: a0352cf5f9d2432ba2a364733c08ddbb, State: Running, Role: LEADER
I20260806 10:46:04.999724 13333 consensus_queue.cc:237] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46279 } } peers { permanent_uuid: "acce42bb90624fc2a82a05e60473f40b" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 33679 } } peers { permanent_uuid: "3764fac3378441e6979750477912a3ff" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37347 } }
I20260806 10:46:05.004458 12688 catalog_manager.cc:5495] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb reported cstate change: term changed from 0 to 1, leader changed from <none> to a0352cf5f9d2432ba2a364733c08ddbb (127.16.45.66). New cstate: current_term: 1 leader_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0352cf5f9d2432ba2a364733c08ddbb" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acce42bb90624fc2a82a05e60473f40b" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 33679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3764fac3378441e6979750477912a3ff" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37347 } health_report { overall_health: UNKNOWN } } }
I20260806 10:46:05.081912 13321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:05.076999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56384 (local address 127.16.45.66:46279)
0806 10:46:05.077174 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:05.077178 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:05.077197 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:46:05.077295 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:05.077299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:05.077380 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:05.077506 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:05.077793 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:05.078601 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:05.080031 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:05.080445 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:05.080534 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:05.080960 (+ 426us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:05.081484 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:05.081596 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:05.081632 (+ 36us) server_negotiation.cc:299] Negotiation successful
0806 10:46:05.081694 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 10:46:05.090092 13250 raft_consensus.cc:1261] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff [term 1 FOLLOWER]: Refusing update from remote peer a0352cf5f9d2432ba2a364733c08ddbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:46:05.090088 12898 raft_consensus.cc:1261] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b [term 1 FOLLOWER]: Refusing update from remote peer a0352cf5f9d2432ba2a364733c08ddbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:46:05.091190 13333 consensus_queue.cc:1035] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3764fac3378441e6979750477912a3ff" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 37347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:46:05.091889 13333 consensus_queue.cc:1035] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "acce42bb90624fc2a82a05e60473f40b" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 33679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:46:05.108045 13346 mvcc.cc:205] Tried to move back new op lower bound from 7315509924198326272 to 7315509923842789376. Current Snapshot: MvccSnapshot[applied={T|T < 7315509924198326272}]
I20260806 10:46:05.110383 13350 mvcc.cc:205] Tried to move back new op lower bound from 7315509924198326272 to 7315509923842789376. Current Snapshot: MvccSnapshot[applied={T|T < 7315509924198326272}]
I20260806 10:46:05.110805 13344 mvcc.cc:205] Tried to move back new op lower bound from 7315509924198326272 to 7315509923842789376. Current Snapshot: MvccSnapshot[applied={T|T < 7315509924198326272}]
I20260806 10:46:05.124832 12688 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:46:05.125120 12688 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:46:05.128947 12688 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5c6cfb8d546e432a928cfc5743ab40ea: Sending DeleteTablet for 3 replicas of tablet 6fe6207187d64c009e5e64a6b361d523
I20260806 10:46:05.130123 13052 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fe6207187d64c009e5e64a6b361d523 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:46:05 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:56370
I20260806 10:46:05.130223 12868 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fe6207187d64c009e5e64a6b361d523 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:46:05 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:44660
I20260806 10:46:05.130434 13225 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fe6207187d64c009e5e64a6b361d523 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:46:05 UTC) from {username='kudu', principal='kudu/127.16.45.126@KRBTEST.COM'} at 127.0.0.1:58134
I20260806 10:46:05.132336 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 12774
I20260806 10:46:05.145839 13363 tablet_replica.cc:330] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff: stopping tablet replica
I20260806 10:46:05.146600 13363 raft_consensus.cc:2229] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:46:05.147358 13363 raft_consensus.cc:2258] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:46:05.149677 13363 ts_tablet_manager.cc:1905] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:46:05.151473 13362 tablet_replica.cc:330] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b: stopping tablet replica
I20260806 10:46:05.154985 13362 raft_consensus.cc:2229] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:46:05.155609 13362 raft_consensus.cc:2258] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:46:05.156243 13361 tablet_replica.cc:330] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb: stopping tablet replica
I20260806 10:46:05.156704 13363 ts_tablet_manager.cc:1918] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:46:05.156952 13363 log.cc:1196] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/6fe6207187d64c009e5e64a6b361d523
I20260806 10:46:05.157625 13363 ts_tablet_manager.cc:1939] T 6fe6207187d64c009e5e64a6b361d523 P 3764fac3378441e6979750477912a3ff: Deleting consensus metadata
I20260806 10:46:05.158104 13361 raft_consensus.cc:2229] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:46:05.160063 12661 catalog_manager.cc:4841] TS 3764fac3378441e6979750477912a3ff (127.16.45.67:37347): tablet 6fe6207187d64c009e5e64a6b361d523 (table test-table [id=8f562a3329f04fbfafec2521f4cac28d]) successfully deleted
I20260806 10:46:05.160179 13362 ts_tablet_manager.cc:1905] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 10:46:05 dist-test-slave-fgb3 krb5kdc[12623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.65@KRBTEST.COM
I20260806 10:46:05.161304 13361 raft_consensus.cc:2258] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:46:05.163487 13361 ts_tablet_manager.cc:1905] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:46:05.167323 13362 ts_tablet_manager.cc:1918] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:46:05.167584 13362 log.cc:1196] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/6fe6207187d64c009e5e64a6b361d523
I20260806 10:46:05.168141 13362 ts_tablet_manager.cc:1939] T 6fe6207187d64c009e5e64a6b361d523 P acce42bb90624fc2a82a05e60473f40b: Deleting consensus metadata
I20260806 10:46:05.170161 12662 catalog_manager.cc:4841] TS acce42bb90624fc2a82a05e60473f40b (127.16.45.65:33679): tablet 6fe6207187d64c009e5e64a6b361d523 (table test-table [id=8f562a3329f04fbfafec2521f4cac28d]) successfully deleted
I20260806 10:46:05.171192 13324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:05.133826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44672 (local address 127.16.45.65:33679)
0806 10:46:05.134476 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:05.134483 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:05.148379 (+ 13896us) server_negotiation.cc:407] Connection header received
0806 10:46:05.148722 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:05.148729 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:05.148850 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:05.148931 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:05.151684 (+ 2753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:05.152788 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:05.156094 (+ 3306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:05.156791 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:05.156907 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:05.162914 (+ 6007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:05.162930 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:05.162949 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:05.163002 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:05.167135 (+ 4133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:05.168149 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:05.168158 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:05.168161 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:05.168334 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:05.169122 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:05.169127 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:05.169130 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:05.169630 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:05.169943 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:05.170564 (+ 621us) server_negotiation.cc:299] Negotiation successful
0806 10:46:05.170805 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517}
I20260806 10:46:05.171587 13361 ts_tablet_manager.cc:1918] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:46:05.171746 13361 log.cc:1196] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/6fe6207187d64c009e5e64a6b361d523
I20260806 10:46:05.172283 13361 ts_tablet_manager.cc:1939] T 6fe6207187d64c009e5e64a6b361d523 P a0352cf5f9d2432ba2a364733c08ddbb: Deleting consensus metadata
I20260806 10:46:05.172747 12953 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:05.174139 12664 catalog_manager.cc:4841] TS a0352cf5f9d2432ba2a364733c08ddbb (127.16.45.66:46279): tablet 6fe6207187d64c009e5e64a6b361d523 (table test-table [id=8f562a3329f04fbfafec2521f4cac28d]) successfully deleted
I20260806 10:46:05.310077 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 12774
I20260806 10:46:05.333055 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 12971
Aug 06 10:46:05 dist-test-slave-fgb3 krb5kdc[12623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.66@KRBTEST.COM
I20260806 10:46:05.349057 13321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:05.333991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56394 (local address 127.16.45.66:46279)
0806 10:46:05.334198 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:05.334204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:05.334224 (+ 20us) server_negotiation.cc:407] Connection header received
0806 10:46:05.334294 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:05.334297 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:05.334406 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:05.334504 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:05.335816 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:05.336629 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:05.337863 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:05.338481 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:05.338600 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:05.343006 (+ 4406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:05.343023 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:05.343046 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:05.343099 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:05.346092 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:05.346895 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:05.346905 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:05.346909 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:05.347053 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:05.347479 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:05.347483 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:05.347485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:05.347864 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:05.348195 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:05.348473 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 10:46:05.348695 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 10:46:05.349771 13129 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:05.463522 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 12971
I20260806 10:46:05.487142 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 13143
Aug 06 10:46:05 dist-test-slave-fgb3 krb5kdc[12623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.67@KRBTEST.COM
I20260806 10:46:05.502526 13325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:05.487887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58144 (local address 127.16.45.67:37347)
0806 10:46:05.488042 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:05.488047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:05.488065 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:46:05.488212 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:05.488216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:05.488290 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:05.488372 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:05.489741 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:05.490550 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:05.491909 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:05.492322 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:05.492419 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:05.496800 (+ 4381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:05.496816 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:05.496835 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:05.496878 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:05.499670 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:05.500387 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:05.500395 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:05.500398 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:05.500559 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:05.500956 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:05.500960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:05.500962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:05.501404 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:05.501643 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:05.501966 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 10:46:05.502163 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 10:46:05.503141 13295 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:05.592350 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 13143
I20260806 10:46:05.613808 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 12638
I20260806 10:46:05.614894 12734 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:05.725672 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 12638
2026-08-06T10:46:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4795 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T10:46:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:05Z Disabled control of system clock
I20260806 10:46:05.817010 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:33115
--webserver_interface=127.16.45.126
--webserver_port=0
--builtin_ntp_servers=127.16.45.84:36331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:33115
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 10:46:06.150009 13375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:06.150338 13375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:06.150465 13375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:06.157773 13375 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:06.157886 13375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:06.157924 13375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:06.158000 13375 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:06.158046 13375 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:06.167510 13375 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:33115
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:33115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:06.168809 13375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:06.170634 13375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:06.181945 13381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:06.182207 13385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:06.181914 13387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:06.183018 13375 server_base.cc:1034] running on GCE node
I20260806 10:46:06.183821 13375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:06.185278 13375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:06.186494 13375 hybrid_clock.cc:648] HybridClock initialized: now 1786013166186444 us; error 47 us; skew 500 ppm
I20260806 10:46:06.186849 13375 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:46:06.189146 13375 webserver.cc:460] Webserver started at http://127.16.45.126:35787/ using document root <none> and password file <none>
I20260806 10:46:06.189855 13375 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:06.189962 13375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:06.190291 13375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:06.193305 13375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "bd53e03c6af1436b8dffb52ad4273142"
format_stamp: "Formatted at 2026-08-06 10:46:06 on dist-test-slave-fgb3"
server_key: "0122bc760cd5b054add3a81f2593268c"
server_key_iv: "732566e0f4e73e139556c8eea061ff30"
server_key_version: "encryptionkey@0"
I20260806 10:46:06.194151 13375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "bd53e03c6af1436b8dffb52ad4273142"
format_stamp: "Formatted at 2026-08-06 10:46:06 on dist-test-slave-fgb3"
server_key: "0122bc760cd5b054add3a81f2593268c"
server_key_iv: "732566e0f4e73e139556c8eea061ff30"
server_key_version: "encryptionkey@0"
I20260806 10:46:06.199707 13375 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260806 10:46:06.203433 13394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:06.204829 13375 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 10:46:06.205039 13375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "bd53e03c6af1436b8dffb52ad4273142"
format_stamp: "Formatted at 2026-08-06 10:46:06 on dist-test-slave-fgb3"
server_key: "0122bc760cd5b054add3a81f2593268c"
server_key_iv: "732566e0f4e73e139556c8eea061ff30"
server_key_version: "encryptionkey@0"
I20260806 10:46:06.205258 13375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:06.218210 13375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:06.219144 13375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:06.219444 13375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:06.238447 13375 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:33115
I20260806 10:46:06.238497 13461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:33115 every 8 connection(s)
I20260806 10:46:06.239782 13375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:06.243784 13462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:06.245431 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 13375
I20260806 10:46:06.245599 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:06.246006 16565 external_mini_cluster.cc:1428] Setting key 2b08965c26ff9a7e87f982350fb90ca6
I20260806 10:46:06.257609 13462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142: Bootstrap starting.
I20260806 10:46:06.259526 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:06.247889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49472 (local address 127.16.45.126:33115)
0806 10:46:06.248940 (+ 1051us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:06.248951 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:06.249004 (+ 53us) server_negotiation.cc:407] Connection header received
0806 10:46:06.250641 (+ 1637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:06.250668 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:06.251150 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:06.251462 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:06.252079 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:06.253409 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:06.255251 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:06.255935 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:06.256075 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:06.257260 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:06.257267 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:06.257282 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:06.257833 (+ 551us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:06.257910 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:06.257932 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:06.258036 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:06.258246 (+ 210us) server_negotiation.cc:299] Negotiation successful
0806 10:46:06.258574 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":380,"threads_started":1}
I20260806 10:46:06.260907 13462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:06.261924 13462 log.cc:824] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:06.264648 13462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142: No bootstrap required, opened a new log
I20260806 10:46:06.271899 13462 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd53e03c6af1436b8dffb52ad4273142" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33115 } }
I20260806 10:46:06.272302 13462 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:06.272396 13462 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd53e03c6af1436b8dffb52ad4273142, State: Initialized, Role: FOLLOWER
I20260806 10:46:06.272991 13462 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd53e03c6af1436b8dffb52ad4273142" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33115 } }
I20260806 10:46:06.273234 13462 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:06.273389 13462 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:06.273573 13462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:06.275799 13462 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd53e03c6af1436b8dffb52ad4273142" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33115 } }
I20260806 10:46:06.276280 13462 leader_election.cc:302] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd53e03c6af1436b8dffb52ad4273142; no voters:
I20260806 10:46:06.276832 13462 leader_election.cc:288] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:06.276971 13469 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:06.277643 13469 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [term 1 LEADER]: Becoming Leader. State: Replica: bd53e03c6af1436b8dffb52ad4273142, State: Running, Role: LEADER
I20260806 10:46:06.278214 13469 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd53e03c6af1436b8dffb52ad4273142" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33115 } }
I20260806 10:46:06.278950 13462 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:06.280815 13473 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd53e03c6af1436b8dffb52ad4273142" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd53e03c6af1436b8dffb52ad4273142" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33115 } } }
I20260806 10:46:06.281250 13473 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:06.284425 13474 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd53e03c6af1436b8dffb52ad4273142. Latest consensus state: current_term: 1 leader_uuid: "bd53e03c6af1436b8dffb52ad4273142" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd53e03c6af1436b8dffb52ad4273142" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 33115 } } }
I20260806 10:46:06.284741 13474 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:06.286398 13484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:06.292128 13484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:06.301802 13484 catalog_manager.cc:1347] Generated new cluster ID: 7a3e7b8728fa4e3c903b1abe9666ac6b
I20260806 10:46:06.301939 13484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:06.322609 13484 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:06.323947 13484 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:06.334077 13484 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142: Generated new TSK 0
I20260806 10:46:06.335210 13484 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:06.346050 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.65:0
--local_ip_for_outbound_sockets=127.16.45.65
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33115
--builtin_ntp_servers=127.16.45.84:36331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 10:46:06.676712 13503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:06.677027 13503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:06.677160 13503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:06.684754 13503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:06.684882 13503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:06.685043 13503 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.65
I20260806 10:46:06.694883 13503 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.45.65
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.65
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:06.696251 13503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:06.698166 13503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:06.711611 13516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:06.711647 13514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:06.712051 13519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:06.712462 13503 server_base.cc:1034] running on GCE node
I20260806 10:46:06.713009 13503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:06.713881 13503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:06.715093 13503 hybrid_clock.cc:648] HybridClock initialized: now 1786013166715043 us; error 32 us; skew 500 ppm
I20260806 10:46:06.715459 13503 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:46:06.717670 13503 webserver.cc:460] Webserver started at http://127.16.45.65:42417/ using document root <none> and password file <none>
I20260806 10:46:06.718417 13503 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:06.718532 13503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:06.718855 13503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:06.721758 13503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/data/instance:
uuid: "07f073f05092481c801ad2c43c1d17e3"
format_stamp: "Formatted at 2026-08-06 10:46:06 on dist-test-slave-fgb3"
server_key: "f44d2916131dc72c58a261e062b3e439"
server_key_iv: "e0ca9351f0f15255d442f78b0594a242"
server_key_version: "encryptionkey@0"
I20260806 10:46:06.722646 13503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance:
uuid: "07f073f05092481c801ad2c43c1d17e3"
format_stamp: "Formatted at 2026-08-06 10:46:06 on dist-test-slave-fgb3"
server_key: "f44d2916131dc72c58a261e062b3e439"
server_key_iv: "e0ca9351f0f15255d442f78b0594a242"
server_key_version: "encryptionkey@0"
I20260806 10:46:06.727731 13503 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 10:46:06.731165 13525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:06.732493 13503 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:46:06.732647 13503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/wal
uuid: "07f073f05092481c801ad2c43c1d17e3"
format_stamp: "Formatted at 2026-08-06 10:46:06 on dist-test-slave-fgb3"
server_key: "f44d2916131dc72c58a261e062b3e439"
server_key_iv: "e0ca9351f0f15255d442f78b0594a242"
server_key_version: "encryptionkey@0"
I20260806 10:46:06.732856 13503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:06.752279 13503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:06.753167 13503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:06.753535 13503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:06.754624 13503 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:46:06.756187 13503 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:46:06.756301 13503 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:06.756422 13503 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:46:06.756510 13503 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:06.789518 13503 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.65:37901
I20260806 10:46:06.789584 13672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.65:37901 every 8 connection(s)
I20260806 10:46:06.790989 13503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/data/info.pb
I20260806 10:46:06.797597 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 13503
I20260806 10:46:06.797804 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/wal/instance
I20260806 10:46:06.798399 16565 external_mini_cluster.cc:1428] Setting key de67033c3937ed0672884bca4899ce13
I20260806 10:46:06.801596 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.66:0
--local_ip_for_outbound_sockets=127.16.45.66
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33115
--builtin_ntp_servers=127.16.45.84:36331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 10:46:06.805163 13676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:06.793706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.65:41737 (local address 127.16.45.126:33115)
0806 10:46:06.794233 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:06.794241 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:06.795475 (+ 1234us) server_negotiation.cc:407] Connection header received
0806 10:46:06.797226 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:06.797231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:06.797306 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:06.797423 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:06.798970 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:06.799865 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:06.802198 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:06.802701 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:06.802815 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:06.804429 (+ 1614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:06.804434 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:06.804437 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:06.804456 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:06.804507 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:06.804520 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:06.804589 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:06.804816 (+ 227us) server_negotiation.cc:299] Negotiation successful
0806 10:46:06.804900 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":369,"thread_start_us":239,"threads_started":1}
I20260806 10:46:06.806564 13677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:06.794246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33115 (local address 127.16.45.65:41737)
0806 10:46:06.795243 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:06.795326 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:06.796954 (+ 1628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:06.797697 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:06.797710 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:06.797841 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:06.798745 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:06.798775 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:06.800030 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:06.800035 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:06.802033 (+ 1998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:06.802048 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:06.802942 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:06.802949 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:06.803242 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:06.804040 (+ 798us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:46:06.804044 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:06.804100 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:46:06.804211 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:06.804606 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:06.804617 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:06.804625 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 10:46:06.804812 (+ 187us) client_negotiation.cc:240] Negotiation successful
0806 10:46:06.805224 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":291,"threads_started":1}
I20260806 10:46:06.808172 13673 heartbeater.cc:347] Connected to a master server at 127.16.45.126:33115
I20260806 10:46:06.808509 13673 heartbeater.cc:464] Registering TS with master...
I20260806 10:46:06.809484 13673 heartbeater.cc:511] Master 127.16.45.126:33115 requested a full tablet report, sending...
I20260806 10:46:06.811825 13415 ts_manager.cc:194] Registered new tserver with Master: 07f073f05092481c801ad2c43c1d17e3 (127.16.45.65:37901)
I20260806 10:46:06.813354 13415 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.45.65:41737
W20260806 10:46:07.132470 13678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:07.132761 13678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:07.132846 13678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:07.140479 13678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:07.140589 13678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:07.140697 13678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.66
I20260806 10:46:07.149827 13678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.45.66
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.66
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:07.151113 13678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:07.152829 13678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:07.165299 13690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:07.165377 13684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:07.165323 13683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:07.166374 13678 server_base.cc:1034] running on GCE node
I20260806 10:46:07.167066 13678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:07.168015 13678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:07.169227 13678 hybrid_clock.cc:648] HybridClock initialized: now 1786013167169177 us; error 43 us; skew 500 ppm
I20260806 10:46:07.169561 13678 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:46:07.171725 13678 webserver.cc:460] Webserver started at http://127.16.45.66:35975/ using document root <none> and password file <none>
I20260806 10:46:07.172423 13678 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:07.172519 13678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:07.172811 13678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:07.175626 13678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/data/instance:
uuid: "a588c321500d4017b299d94573348422"
format_stamp: "Formatted at 2026-08-06 10:46:07 on dist-test-slave-fgb3"
server_key: "6c79b3065a1a94d7eb87bb507c185fc1"
server_key_iv: "905d66cb3e173ee53e6746748390c73e"
server_key_version: "encryptionkey@0"
I20260806 10:46:07.176367 13678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance:
uuid: "a588c321500d4017b299d94573348422"
format_stamp: "Formatted at 2026-08-06 10:46:07 on dist-test-slave-fgb3"
server_key: "6c79b3065a1a94d7eb87bb507c185fc1"
server_key_iv: "905d66cb3e173ee53e6746748390c73e"
server_key_version: "encryptionkey@0"
I20260806 10:46:07.181418 13678 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 10:46:07.184835 13696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:07.186096 13678 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:46:07.186266 13678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/wal
uuid: "a588c321500d4017b299d94573348422"
format_stamp: "Formatted at 2026-08-06 10:46:07 on dist-test-slave-fgb3"
server_key: "6c79b3065a1a94d7eb87bb507c185fc1"
server_key_iv: "905d66cb3e173ee53e6746748390c73e"
server_key_version: "encryptionkey@0"
I20260806 10:46:07.186580 13678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:07.200973 13678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:07.201740 13678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:07.202019 13678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:07.203037 13678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:46:07.204414 13678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:46:07.204509 13678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:07.204613 13678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:46:07.204682 13678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:07.236414 13678 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.66:46757
I20260806 10:46:07.236472 13846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.66:46757 every 8 connection(s)
I20260806 10:46:07.237872 13678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/data/info.pb
I20260806 10:46:07.242929 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 13678
I20260806 10:46:07.243108 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/wal/instance
I20260806 10:46:07.243675 16565 external_mini_cluster.cc:1428] Setting key 4653992c7030befdc1ad917a563275eb
I20260806 10:46:07.246858 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.45.67:0
--local_ip_for_outbound_sockets=127.16.45.67
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33115
--builtin_ntp_servers=127.16.45.84:36331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 10:46:07.251072 13676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:07.240647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:34097 (local address 127.16.45.126:33115)
0806 10:46:07.240863 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:07.240869 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:07.242340 (+ 1471us) server_negotiation.cc:407] Connection header received
0806 10:46:07.244715 (+ 2375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:07.244722 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:07.244801 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:07.244899 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:07.246167 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.246940 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.248492 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.248888 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.249001 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:07.250243 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:07.250248 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:07.250251 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:07.250269 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:07.250300 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:07.250334 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:07.250412 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:07.250625 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 10:46:07.250723 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 10:46:07.252040 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:07.241103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33115 (local address 127.16.45.66:34097)
0806 10:46:07.242138 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:07.242189 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:07.244431 (+ 2242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:07.245163 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:07.245175 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:07.245289 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:07.246009 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:07.246027 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.247130 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.247136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:07.248337 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:07.248349 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.249101 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.249109 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:07.249316 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:07.249940 (+ 624us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:46:07.249943 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:07.249981 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:46:07.250050 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:07.250435 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:07.250446 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:07.250451 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 10:46:07.250600 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 10:46:07.250959 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":330,"threads_started":1}
I20260806 10:46:07.253304 13847 heartbeater.cc:347] Connected to a master server at 127.16.45.126:33115
I20260806 10:46:07.253574 13847 heartbeater.cc:464] Registering TS with master...
I20260806 10:46:07.254298 13847 heartbeater.cc:511] Master 127.16.45.126:33115 requested a full tablet report, sending...
I20260806 10:46:07.255606 13415 ts_manager.cc:194] Registered new tserver with Master: a588c321500d4017b299d94573348422 (127.16.45.66:46757)
I20260806 10:46:07.256367 13415 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.45.66:34097
W20260806 10:46:07.572103 13851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:07.572399 13851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:07.572525 13851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:07.579988 13851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:07.580096 13851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:07.580245 13851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.45.67
I20260806 10:46:07.589510 13851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:36331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.45.67
--webserver_port=0
--tserver_master_addrs=127.16.45.126:33115
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.45.67
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:07.590866 13851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:07.592669 13851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:07.605068 13865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:07.605083 13862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:07.605365 13861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:07.606123 13851 server_base.cc:1034] running on GCE node
I20260806 10:46:07.606776 13851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:07.607745 13851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:07.608987 13851 hybrid_clock.cc:648] HybridClock initialized: now 1786013167608924 us; error 51 us; skew 500 ppm
I20260806 10:46:07.609377 13851 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 10:46:07.611677 13851 webserver.cc:460] Webserver started at http://127.16.45.67:45375/ using document root <none> and password file <none>
I20260806 10:46:07.612344 13851 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:07.612447 13851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:07.612737 13851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:07.615706 13851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/data/instance:
uuid: "a3f30e54af2b40828c74c37402b818f2"
format_stamp: "Formatted at 2026-08-06 10:46:07 on dist-test-slave-fgb3"
server_key: "717dcf12e674f122af27fba0e3b04fa7"
server_key_iv: "5c93410d6a02b30b929a697f66d4834e"
server_key_version: "encryptionkey@0"
I20260806 10:46:07.616463 13851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance:
uuid: "a3f30e54af2b40828c74c37402b818f2"
format_stamp: "Formatted at 2026-08-06 10:46:07 on dist-test-slave-fgb3"
server_key: "717dcf12e674f122af27fba0e3b04fa7"
server_key_iv: "5c93410d6a02b30b929a697f66d4834e"
server_key_version: "encryptionkey@0"
I20260806 10:46:07.621356 13851 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:46:07.624629 13873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:07.625880 13851 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 10:46:07.626029 13851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/wal
uuid: "a3f30e54af2b40828c74c37402b818f2"
format_stamp: "Formatted at 2026-08-06 10:46:07 on dist-test-slave-fgb3"
server_key: "717dcf12e674f122af27fba0e3b04fa7"
server_key_iv: "5c93410d6a02b30b929a697f66d4834e"
server_key_version: "encryptionkey@0"
I20260806 10:46:07.626220 13851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:07.644871 13851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:07.645686 13851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:07.645992 13851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:07.646994 13851 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 10:46:07.648558 13851 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 10:46:07.648661 13851 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:07.648766 13851 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 10:46:07.648836 13851 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:07.678843 13851 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.67:41051
I20260806 10:46:07.678921 14023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.67:41051 every 8 connection(s)
I20260806 10:46:07.680285 13851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/data/info.pb
I20260806 10:46:07.686925 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 13851
I20260806 10:46:07.687095 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/wal/instance
I20260806 10:46:07.687575 16565 external_mini_cluster.cc:1428] Setting key 5b57e538cc5edb08850dd18ac99a658d
I20260806 10:46:07.693130 13676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:07.682792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.67:59245 (local address 127.16.45.126:33115)
0806 10:46:07.682967 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:07.682972 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:07.684389 (+ 1417us) server_negotiation.cc:407] Connection header received
0806 10:46:07.686186 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:07.686192 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:07.686275 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:07.686414 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:07.687514 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.688507 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.690767 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.691226 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.691326 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:07.692526 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:07.692530 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:07.692533 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:07.692551 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:07.692584 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:07.692595 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:07.692663 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:07.692821 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 10:46:07.692899 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 10:46:07.694134 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:07.683348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:33115 (local address 127.16.45.67:59245)
0806 10:46:07.684229 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:07.684271 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:07.685926 (+ 1655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:07.686625 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:07.686633 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:07.686719 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:07.687333 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:07.687352 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.688687 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.688692 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:07.690621 (+ 1929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:07.690637 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.691410 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.691416 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:07.691610 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:07.692212 (+ 602us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 10:46:07.692215 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:07.692254 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 10:46:07.692337 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:07.692667 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:07.692673 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:07.692679 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 10:46:07.692808 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 10:46:07.693101 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":263,"threads_started":1}
I20260806 10:46:07.695415 14024 heartbeater.cc:347] Connected to a master server at 127.16.45.126:33115
I20260806 10:46:07.695674 14024 heartbeater.cc:464] Registering TS with master...
I20260806 10:46:07.696393 14024 heartbeater.cc:511] Master 127.16.45.126:33115 requested a full tablet report, sending...
I20260806 10:46:07.697723 13415 ts_manager.cc:194] Registered new tserver with Master: a3f30e54af2b40828c74c37402b818f2 (127.16.45.67:41051)
I20260806 10:46:07.698583 13415 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.45.67:59245
I20260806 10:46:07.702922 16565 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 10:46:07.713025 13676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:07.706979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49486 (local address 127.16.45.126:33115)
0806 10:46:07.707193 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:07.707200 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:07.707640 (+ 440us) server_negotiation.cc:407] Connection header received
0806 10:46:07.707817 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:07.707821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:07.707903 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:07.707984 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:07.708518 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.709320 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.710768 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.711212 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.711323 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:07.712364 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:07.712369 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:07.712372 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:07.712389 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:07.712421 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:07.712433 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:07.712505 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:07.712637 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 10:46:07.712731 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 10:46:07.716764 13415 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49486:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 10:46:07.723613 13415 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 10:46:07.745839 14039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:07.735445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.66:46757 (local address 127.0.0.1:56746)
0806 10:46:07.736372 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:07.736412 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:07.736579 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:07.738496 (+ 1917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:07.738503 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:07.738532 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:07.739040 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:07.739053 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.741022 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.741028 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:07.743080 (+ 2052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:07.743096 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.744845 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.744852 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:07.745045 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:07.745103 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 10:46:07.745238 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 10:46:07.745424 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"mutex_wait_us":63,"thread_start_us":1378,"threads_started":1}
I20260806 10:46:07.745849 14040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:07.735707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56746 (local address 127.16.45.66:46757)
0806 10:46:07.737814 (+ 2107us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:07.737824 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:07.737857 (+ 33us) server_negotiation.cc:407] Connection header received
0806 10:46:07.737989 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:07.737997 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:07.738237 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:07.739075 (+ 838us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:07.739344 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.740886 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.743268 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.744654 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.744787 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:07.745061 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:07.745291 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 10:46:07.745463 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1947,"thread_start_us":1832,"threads_started":1}
I20260806 10:46:07.746670 14041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:07.735920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41952 (local address 127.16.45.67:41051)
0806 10:46:07.738212 (+ 2292us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:07.738220 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:07.738256 (+ 36us) server_negotiation.cc:407] Connection header received
0806 10:46:07.738385 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:07.738392 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:07.738604 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:07.739573 (+ 969us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:07.739957 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.741286 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.743737 (+ 2451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.744944 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.745830 (+ 886us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:07.746090 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:07.746151 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 10:46:07.746300 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2115,"thread_start_us":1947,"threads_started":1}
I20260806 10:46:07.746390 14036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:07.735564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:41051 (local address 127.0.0.1:41952)
0806 10:46:07.737113 (+ 1549us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:07.737205 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:07.737330 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:07.738846 (+ 1516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:07.738851 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:07.738888 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:07.739382 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:07.739397 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.741408 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.741413 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:07.743512 (+ 2099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:07.743527 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.745151 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.745157 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:07.745314 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:07.745354 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 10:46:07.745409 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 10:46:07.745504 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1411,"mutex_wait_us":27,"thread_start_us":281,"threads_started":1}
I20260806 10:46:07.746937 14042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:07.737288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:37901 (local address 127.0.0.1:41024)
0806 10:46:07.739050 (+ 1762us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:07.739067 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:07.739184 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:07.739635 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:07.739639 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:07.739661 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:07.740197 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:07.740210 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.742076 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.742081 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:07.744282 (+ 2201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:07.744297 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.746203 (+ 1906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.746207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:07.746366 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:07.746400 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 10:46:07.746476 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 10:46:07.746594 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1633,"mutex_wait_us":84,"thread_start_us":1481,"threads_started":1}
I20260806 10:46:07.747603 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:07.737771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41024 (local address 127.16.45.65:37901)
0806 10:46:07.738563 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:07.738570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:07.739240 (+ 670us) server_negotiation.cc:407] Connection header received
0806 10:46:07.739329 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:07.739333 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:07.739475 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:07.739622 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:07.740425 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.741934 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.744452 (+ 2518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:07.745743 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:07.745872 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:07.746098 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:07.747142 (+ 1044us) server_negotiation.cc:299] Negotiation successful
0806 10:46:07.747302 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":522,"threads_started":1}
I20260806 10:46:07.750463 13931 tablet_service.cc:1467] Processing CreateTablet for tablet 09cbd79b47e54ea3a2b1370b345c7ca8 (DEFAULT_TABLE table=test-table [id=a4e2b23b6d114d7f88692a41840df984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:46:07.750495 13762 tablet_service.cc:1467] Processing CreateTablet for tablet 09cbd79b47e54ea3a2b1370b345c7ca8 (DEFAULT_TABLE table=test-table [id=a4e2b23b6d114d7f88692a41840df984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:46:07.750897 13591 tablet_service.cc:1467] Processing CreateTablet for tablet 09cbd79b47e54ea3a2b1370b345c7ca8 (DEFAULT_TABLE table=test-table [id=a4e2b23b6d114d7f88692a41840df984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 10:46:07.751755 13931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09cbd79b47e54ea3a2b1370b345c7ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:07.751936 13762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09cbd79b47e54ea3a2b1370b345c7ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:07.752051 13591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09cbd79b47e54ea3a2b1370b345c7ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:07.763113 14044 tablet_bootstrap.cc:492] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2: Bootstrap starting.
I20260806 10:46:07.766011 14046 tablet_bootstrap.cc:492] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3: Bootstrap starting.
I20260806 10:46:07.766502 14044 tablet_bootstrap.cc:654] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:07.766849 14048 tablet_bootstrap.cc:492] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422: Bootstrap starting.
I20260806 10:46:07.767899 14044 log.cc:824] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:07.770269 14048 tablet_bootstrap.cc:654] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:07.770853 14044 tablet_bootstrap.cc:492] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2: No bootstrap required, opened a new log
I20260806 10:46:07.771106 14044 ts_tablet_manager.cc:1397] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260806 10:46:07.771519 14048 log.cc:824] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:07.772360 14046 tablet_bootstrap.cc:654] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:07.773425 14046 log.cc:824] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:07.774478 14048 tablet_bootstrap.cc:492] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422: No bootstrap required, opened a new log
I20260806 10:46:07.774721 14048 ts_tablet_manager.cc:1397] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 10:46:07.776377 14046 tablet_bootstrap.cc:492] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3: No bootstrap required, opened a new log
I20260806 10:46:07.776678 14046 ts_tablet_manager.cc:1397] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.007s
I20260806 10:46:07.779073 14044 raft_consensus.cc:348] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a588c321500d4017b299d94573348422" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46757 } } peers { permanent_uuid: "a3f30e54af2b40828c74c37402b818f2" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41051 } } peers { permanent_uuid: "07f073f05092481c801ad2c43c1d17e3" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37901 } }
I20260806 10:46:07.779487 14044 raft_consensus.cc:374] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:07.779585 14044 raft_consensus.cc:729] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3f30e54af2b40828c74c37402b818f2, State: Initialized, Role: FOLLOWER
I20260806 10:46:07.780120 14044 consensus_queue.cc:260] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a588c321500d4017b299d94573348422" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46757 } } peers { permanent_uuid: "a3f30e54af2b40828c74c37402b818f2" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41051 } } peers { permanent_uuid: "07f073f05092481c801ad2c43c1d17e3" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37901 } }
I20260806 10:46:07.781198 14024 heartbeater.cc:503] Master 127.16.45.126:33115 was elected leader, sending a full tablet report...
I20260806 10:46:07.781657 14044 ts_tablet_manager.cc:1428] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260806 10:46:07.785526 14046 raft_consensus.cc:348] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a588c321500d4017b299d94573348422" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46757 } } peers { permanent_uuid: "a3f30e54af2b40828c74c37402b818f2" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41051 } } peers { permanent_uuid: "07f073f05092481c801ad2c43c1d17e3" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37901 } }
I20260806 10:46:07.785974 14046 raft_consensus.cc:374] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:07.786082 14046 raft_consensus.cc:729] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f073f05092481c801ad2c43c1d17e3, State: Initialized, Role: FOLLOWER
I20260806 10:46:07.786187 14048 raft_consensus.cc:348] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a588c321500d4017b299d94573348422" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46757 } } peers { permanent_uuid: "a3f30e54af2b40828c74c37402b818f2" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41051 } } peers { permanent_uuid: "07f073f05092481c801ad2c43c1d17e3" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37901 } }
I20260806 10:46:07.786690 14048 raft_consensus.cc:374] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:07.786794 14048 raft_consensus.cc:729] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a588c321500d4017b299d94573348422, State: Initialized, Role: FOLLOWER
I20260806 10:46:07.786706 14046 consensus_queue.cc:260] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a588c321500d4017b299d94573348422" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46757 } } peers { permanent_uuid: "a3f30e54af2b40828c74c37402b818f2" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41051 } } peers { permanent_uuid: "07f073f05092481c801ad2c43c1d17e3" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37901 } }
I20260806 10:46:07.787331 14048 consensus_queue.cc:260] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a588c321500d4017b299d94573348422" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46757 } } peers { permanent_uuid: "a3f30e54af2b40828c74c37402b818f2" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41051 } } peers { permanent_uuid: "07f073f05092481c801ad2c43c1d17e3" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37901 } }
I20260806 10:46:07.788973 13847 heartbeater.cc:503] Master 127.16.45.126:33115 was elected leader, sending a full tablet report...
I20260806 10:46:07.789611 14048 ts_tablet_manager.cc:1428] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
I20260806 10:46:07.790620 13673 heartbeater.cc:503] Master 127.16.45.126:33115 was elected leader, sending a full tablet report...
I20260806 10:46:07.792908 14046 ts_tablet_manager.cc:1428] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3: Time spent starting tablet: real 0.016s user 0.010s sys 0.003s
W20260806 10:46:07.793253 13675 tablet.cc:2369] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:46:07.931838 14025 tablet.cc:2369] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 10:46:07.990221 13848 tablet.cc:2369] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:46:08.083817 14055 raft_consensus.cc:482] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 10:46:08.084182 14055 raft_consensus.cc:504] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a588c321500d4017b299d94573348422" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46757 } } peers { permanent_uuid: "a3f30e54af2b40828c74c37402b818f2" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41051 } } peers { permanent_uuid: "07f073f05092481c801ad2c43c1d17e3" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37901 } }
I20260806 10:46:08.085973 14055 leader_election.cc:288] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a3f30e54af2b40828c74c37402b818f2 (127.16.45.67:41051), 07f073f05092481c801ad2c43c1d17e3 (127.16.45.65:37901)
I20260806 10:46:08.092945 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:08.086542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:40077 (local address 127.16.45.65:37901)
0806 10:46:08.086738 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:08.086745 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:08.087507 (+ 762us) server_negotiation.cc:407] Connection header received
0806 10:46:08.087768 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:08.087772 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:08.087841 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:08.087922 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:08.088608 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.089282 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.091300 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.092052 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.092208 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:08.092281 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:08.092566 (+ 285us) server_negotiation.cc:299] Negotiation successful
0806 10:46:08.092694 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 10:46:08.092947 14041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:08.086532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.45.66:34795 (local address 127.16.45.67:41051)
0806 10:46:08.086749 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:08.086755 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:08.087495 (+ 740us) server_negotiation.cc:407] Connection header received
0806 10:46:08.087767 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:08.087772 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:08.087833 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:08.087907 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 10:46:08.088522 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.089237 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.091313 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.092079 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.092237 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:08.092310 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:08.092584 (+ 274us) server_negotiation.cc:299] Negotiation successful
0806 10:46:08.092706 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 10:46:08.093096 14058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:08.086532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.65:37901 (local address 127.16.45.66:40077)
0806 10:46:08.087406 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:08.087420 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:08.087625 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:08.087942 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:08.087946 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:08.087978 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:08.088446 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:08.088456 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.089405 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.089410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:08.091120 (+ 1710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:08.091132 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.092262 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.092269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:08.092420 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:08.092444 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 10:46:08.092523 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 10:46:08.092651 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":772,"mutex_wait_us":50,"spinlock_wait_cycles":9728,"thread_start_us":479,"threads_started":1}
I20260806 10:46:08.093189 14056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:08.086469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.67:41051 (local address 127.16.45.66:34795)
0806 10:46:08.087358 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:08.087374 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:08.087628 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:08.087936 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:08.087940 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:08.087975 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 10:46:08.088378 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:08.088388 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.089356 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.089361 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:08.091134 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:08.091147 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.092279 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.092285 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:08.092444 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:08.092466 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 10:46:08.092543 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 10:46:08.092666 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":753,"mutex_wait_us":76,"spinlock_wait_cycles":43264,"thread_start_us":513,"threads_started":1}
I20260806 10:46:08.094250 13616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09cbd79b47e54ea3a2b1370b345c7ca8" candidate_uuid: "a588c321500d4017b299d94573348422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f073f05092481c801ad2c43c1d17e3" is_pre_election: true
I20260806 10:46:08.094250 13960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09cbd79b47e54ea3a2b1370b345c7ca8" candidate_uuid: "a588c321500d4017b299d94573348422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f30e54af2b40828c74c37402b818f2" is_pre_election: true
I20260806 10:46:08.094864 13616 raft_consensus.cc:2454] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a588c321500d4017b299d94573348422 in term 0.
I20260806 10:46:08.094864 13960 raft_consensus.cc:2454] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a588c321500d4017b299d94573348422 in term 0.
I20260806 10:46:08.095535 13702 leader_election.cc:302] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3f30e54af2b40828c74c37402b818f2, a588c321500d4017b299d94573348422; no voters:
I20260806 10:46:08.095906 14055 raft_consensus.cc:2781] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 10:46:08.096041 14055 raft_consensus.cc:482] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 10:46:08.096143 14055 raft_consensus.cc:3037] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:08.098340 14055 raft_consensus.cc:504] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a588c321500d4017b299d94573348422" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46757 } } peers { permanent_uuid: "a3f30e54af2b40828c74c37402b818f2" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41051 } } peers { permanent_uuid: "07f073f05092481c801ad2c43c1d17e3" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37901 } }
I20260806 10:46:08.098969 14055 leader_election.cc:288] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [CANDIDATE]: Term 1 election: Requested vote from peers a3f30e54af2b40828c74c37402b818f2 (127.16.45.67:41051), 07f073f05092481c801ad2c43c1d17e3 (127.16.45.65:37901)
I20260806 10:46:08.099407 13960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09cbd79b47e54ea3a2b1370b345c7ca8" candidate_uuid: "a588c321500d4017b299d94573348422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f30e54af2b40828c74c37402b818f2"
I20260806 10:46:08.099453 13616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09cbd79b47e54ea3a2b1370b345c7ca8" candidate_uuid: "a588c321500d4017b299d94573348422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f073f05092481c801ad2c43c1d17e3"
I20260806 10:46:08.099635 13960 raft_consensus.cc:3037] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:08.099642 13616 raft_consensus.cc:3037] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:08.102825 13960 raft_consensus.cc:2454] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a588c321500d4017b299d94573348422 in term 1.
I20260806 10:46:08.102825 13616 raft_consensus.cc:2454] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a588c321500d4017b299d94573348422 in term 1.
I20260806 10:46:08.103225 13699 leader_election.cc:302] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f073f05092481c801ad2c43c1d17e3, a588c321500d4017b299d94573348422; no voters:
I20260806 10:46:08.103535 14055 raft_consensus.cc:2781] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:08.104043 14055 raft_consensus.cc:686] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 1 LEADER]: Becoming Leader. State: Replica: a588c321500d4017b299d94573348422, State: Running, Role: LEADER
I20260806 10:46:08.104579 14055 consensus_queue.cc:237] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a588c321500d4017b299d94573348422" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46757 } } peers { permanent_uuid: "a3f30e54af2b40828c74c37402b818f2" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41051 } } peers { permanent_uuid: "07f073f05092481c801ad2c43c1d17e3" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37901 } }
I20260806 10:46:08.109021 13413 catalog_manager.cc:5495] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 reported cstate change: term changed from 0 to 1, leader changed from <none> to a588c321500d4017b299d94573348422 (127.16.45.66). New cstate: current_term: 1 leader_uuid: "a588c321500d4017b299d94573348422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a588c321500d4017b299d94573348422" member_type: VOTER last_known_addr { host: "127.16.45.66" port: 46757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3f30e54af2b40828c74c37402b818f2" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07f073f05092481c801ad2c43c1d17e3" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37901 } health_report { overall_health: UNKNOWN } } }
I20260806 10:46:08.202541 14040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:08.197584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56762 (local address 127.16.45.66:46757)
0806 10:46:08.197792 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:08.197798 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:08.197860 (+ 62us) server_negotiation.cc:407] Connection header received
0806 10:46:08.198053 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:08.198057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:08.198143 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:08.198262 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:08.198614 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.199305 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.200669 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.201068 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.201158 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:08.201556 (+ 398us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:08.202027 (+ 471us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:08.202130 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:08.202170 (+ 40us) server_negotiation.cc:299] Negotiation successful
0806 10:46:08.202241 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 10:46:08.210937 13616 raft_consensus.cc:1261] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3 [term 1 FOLLOWER]: Refusing update from remote peer a588c321500d4017b299d94573348422: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:46:08.210949 13960 raft_consensus.cc:1261] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2 [term 1 FOLLOWER]: Refusing update from remote peer a588c321500d4017b299d94573348422: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:46:08.211933 14059 consensus_queue.cc:1035] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3f30e54af2b40828c74c37402b818f2" member_type: VOTER last_known_addr { host: "127.16.45.67" port: 41051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:46:08.212239 14055 consensus_queue.cc:1035] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f073f05092481c801ad2c43c1d17e3" member_type: VOTER last_known_addr { host: "127.16.45.65" port: 37901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:46:08.243000 13413 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49486:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:46:08.243412 13413 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49486:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 10:46:08.247906 13413 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bd53e03c6af1436b8dffb52ad4273142: Sending DeleteTablet for 3 replicas of tablet 09cbd79b47e54ea3a2b1370b345c7ca8
I20260806 10:46:08.249158 13762 tablet_service.cc:1514] Processing DeleteTablet for tablet 09cbd79b47e54ea3a2b1370b345c7ca8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:46:08 UTC) from {username='slave'} at 127.0.0.1:56746
I20260806 10:46:08.249925 13931 tablet_service.cc:1514] Processing DeleteTablet for tablet 09cbd79b47e54ea3a2b1370b345c7ca8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:46:08 UTC) from {username='slave'} at 127.0.0.1:41952
I20260806 10:46:08.250129 14073 tablet_replica.cc:330] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422: stopping tablet replica
I20260806 10:46:08.250589 14073 raft_consensus.cc:2229] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 1 LEADER]: Raft consensus shutting down.
I20260806 10:46:08.250926 13591 tablet_service.cc:1514] Processing DeleteTablet for tablet 09cbd79b47e54ea3a2b1370b345c7ca8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 10:46:08 UTC) from {username='slave'} at 127.0.0.1:41024
I20260806 10:46:08.251251 14073 raft_consensus.cc:2258] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:46:08.252432 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 13503
I20260806 10:46:08.253408 14073 ts_tablet_manager.cc:1905] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:46:08.261684 14073 ts_tablet_manager.cc:1918] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:46:08.261951 14073 log.cc:1196] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-1/wal/wals/09cbd79b47e54ea3a2b1370b345c7ca8
I20260806 10:46:08.262602 14073 ts_tablet_manager.cc:1939] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a588c321500d4017b299d94573348422: Deleting consensus metadata
I20260806 10:46:08.264663 13395 catalog_manager.cc:4841] TS a588c321500d4017b299d94573348422 (127.16.45.66:46757): tablet 09cbd79b47e54ea3a2b1370b345c7ca8 (table test-table [id=a4e2b23b6d114d7f88692a41840df984]) successfully deleted
I20260806 10:46:08.274807 14074 tablet_replica.cc:330] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2: stopping tablet replica
I20260806 10:46:08.276340 14074 raft_consensus.cc:2229] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:46:08.277961 14074 raft_consensus.cc:2258] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:46:08.282097 14076 tablet_replica.cc:330] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3: stopping tablet replica
I20260806 10:46:08.282678 14076 raft_consensus.cc:2229] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 10:46:08.283213 14076 raft_consensus.cc:2258] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 10:46:08.283746 14074 ts_tablet_manager.cc:1905] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:46:08.285290 14076 ts_tablet_manager.cc:1905] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 10:46:08.291360 14074 ts_tablet_manager.cc:1918] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:46:08.291664 14074 log.cc:1196] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-2/wal/wals/09cbd79b47e54ea3a2b1370b345c7ca8
I20260806 10:46:08.291978 14076 ts_tablet_manager.cc:1918] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 10:46:08.292218 14076 log.cc:1196] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3: Deleting WAL directory at /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786012840862403-16565-0/minicluster-data/ts-0/wal/wals/09cbd79b47e54ea3a2b1370b345c7ca8
I20260806 10:46:08.292340 14074 ts_tablet_manager.cc:1939] T 09cbd79b47e54ea3a2b1370b345c7ca8 P a3f30e54af2b40828c74c37402b818f2: Deleting consensus metadata
I20260806 10:46:08.293202 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:08.254436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41030 (local address 127.16.45.65:37901)
0806 10:46:08.254624 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:08.254631 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:08.275546 (+ 20915us) server_negotiation.cc:407] Connection header received
0806 10:46:08.276647 (+ 1101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:08.276653 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:08.276778 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:08.276851 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:08.278181 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.279393 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.285643 (+ 6250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.286366 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.286480 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:08.291338 (+ 4858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:08.291351 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:08.291371 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:08.292202 (+ 831us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:08.292278 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:08.292306 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:08.292408 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:08.292701 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 10:46:08.292839 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 10:46:08.293944 13665 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:08.292860 14076 ts_tablet_manager.cc:1939] T 09cbd79b47e54ea3a2b1370b345c7ca8 P 07f073f05092481c801ad2c43c1d17e3: Deleting consensus metadata
I20260806 10:46:08.294529 13398 catalog_manager.cc:4841] TS a3f30e54af2b40828c74c37402b818f2 (127.16.45.67:41051): tablet 09cbd79b47e54ea3a2b1370b345c7ca8 (table test-table [id=a4e2b23b6d114d7f88692a41840df984]) successfully deleted
I20260806 10:46:08.395709 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 13503
I20260806 10:46:08.395864 13396 catalog_manager.cc:4841] TS 07f073f05092481c801ad2c43c1d17e3 (127.16.45.65:37901): tablet 09cbd79b47e54ea3a2b1370b345c7ca8 (table test-table [id=a4e2b23b6d114d7f88692a41840df984]) successfully deleted
I20260806 10:46:08.423740 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 13678
I20260806 10:46:08.431608 14040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:08.424526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56768 (local address 127.16.45.66:46757)
0806 10:46:08.424722 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:08.424726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:08.424780 (+ 54us) server_negotiation.cc:407] Connection header received
0806 10:46:08.424985 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:08.424990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:08.425079 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:08.425174 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:08.425612 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.426459 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.428320 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.428738 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.428829 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:08.430031 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:08.430040 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:08.430054 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:08.430821 (+ 767us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:08.430890 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:08.430913 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:08.431024 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:08.431174 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 10:46:08.431258 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 10:46:08.432407 13839 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:08.544601 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 13678
I20260806 10:46:08.567368 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 13851
I20260806 10:46:08.573875 14041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:08.568154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41964 (local address 127.16.45.67:41051)
0806 10:46:08.568320 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:08.568324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:08.568342 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:46:08.568493 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:08.568497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:08.568595 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:08.568688 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:08.569017 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.569719 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.571033 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:08.571444 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:08.571536 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:08.572538 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:08.572547 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:08.572562 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:08.573134 (+ 572us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:08.573185 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:08.573205 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:08.573307 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:08.573524 (+ 217us) server_negotiation.cc:299] Negotiation successful
0806 10:46:08.573615 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 10:46:08.574605 14015 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:08.661689 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 13851
I20260806 10:46:08.681571 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 13375
I20260806 10:46:08.682736 13456 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:08.792061 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 13375
2026-08-06T10:46:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3066 ms)
[----------] 6 tests from EncryptionPolicyTest (22562 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:08 dist-test-slave-fgb3 krb5kdc[14087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:08 dist-test-slave-fgb3 krb5kdc[14087](info): set up 2 sockets
Aug 06 10:46:08 dist-test-slave-fgb3 krb5kdc[14087](info): commencing operation
krb5kdc: starting...
W20260806 10:46:10.017556 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.001s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:10 dist-test-slave-fgb3 krb5kdc[14087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 10:46:10.329516 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38739
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38739
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:10.665524 14104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:10.665827 14104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:10.665917 14104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:10.673283 14104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:10.673400 14104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:10.673448 14104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:10.673509 14104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:10.673553 14104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:10.683683 14104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38739
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:10.684926 14104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:10.686182 14104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:10.697624 14114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:10.697683 14109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:10.697712 14112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:10.698377 14104 server_base.cc:1034] running on GCE node
I20260806 10:46:10.699209 14104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:10.700650 14104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:10.701867 14104 hybrid_clock.cc:648] HybridClock initialized: now 1786013170701813 us; error 42 us; skew 500 ppm
I20260806 10:46:10.702232 14104 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:10 dist-test-slave-fgb3 krb5kdc[14087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013170, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:10.705427 14104 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 10:46:10.707150 14104 webserver.cc:460] Webserver started at http://127.0.0.1:38823/ using document root <none> and password file <none>
I20260806 10:46:10.707841 14104 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:10.707964 14104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:10.708256 14104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:10.711294 14104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "c9b00a4b3aa24d2f9a3b43ff5db2b175"
format_stamp: "Formatted at 2026-08-06 10:46:10 on dist-test-slave-fgb3"
server_key: "6933b37ea8793e43c712b5b6b8fd96f1"
server_key_iv: "61635d2c06ec58c70264b1a7b6b9c24f"
server_key_version: "encryptionkey@0"
I20260806 10:46:10.712069 14104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "c9b00a4b3aa24d2f9a3b43ff5db2b175"
format_stamp: "Formatted at 2026-08-06 10:46:10 on dist-test-slave-fgb3"
server_key: "6933b37ea8793e43c712b5b6b8fd96f1"
server_key_iv: "61635d2c06ec58c70264b1a7b6b9c24f"
server_key_version: "encryptionkey@0"
I20260806 10:46:10.717327 14104 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:46:10.720817 14122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:10.722039 14104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:46:10.722198 14104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "c9b00a4b3aa24d2f9a3b43ff5db2b175"
format_stamp: "Formatted at 2026-08-06 10:46:10 on dist-test-slave-fgb3"
server_key: "6933b37ea8793e43c712b5b6b8fd96f1"
server_key_iv: "61635d2c06ec58c70264b1a7b6b9c24f"
server_key_version: "encryptionkey@0"
I20260806 10:46:10.722404 14104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:10.754722 14104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:10.758848 14104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:10.759089 14104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:10.776393 14104 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38739
I20260806 10:46:10.776535 14186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38739 every 8 connection(s)
I20260806 10:46:10.777779 14104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:10.780545 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 14104
I20260806 10:46:10.780784 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:10.781569 16565 external_mini_cluster.cc:1428] Setting key 4319995482531469ed389f9c92d7bcdb
I20260806 10:46:10.781876 14187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:10.796224 14187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175: Bootstrap starting.
Aug 06 10:46:10 dist-test-slave-fgb3 krb5kdc[14087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 10:46:10.799794 14187 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:10.800889 14187 log.cc:824] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:10.803678 14187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175: No bootstrap required, opened a new log
I20260806 10:46:10.805397 14190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:10.783440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48197 (local address 127.0.0.1:38739)
0806 10:46:10.784225 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:10.784237 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:10.784283 (+ 46us) server_negotiation.cc:407] Connection header received
0806 10:46:10.786507 (+ 2224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:10.786531 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:10.786936 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:10.787255 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:10.789173 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:10.790551 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:10.792292 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:10.793053 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:10.793213 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:10.798214 (+ 5001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:10.798223 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:10.798242 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:10.798289 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:10.801339 (+ 3050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:10.802137 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:10.802143 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:10.802150 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:10.802335 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:10.802791 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:10.802795 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:10.802797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:10.803296 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:10.803593 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:10.804085 (+ 492us) server_negotiation.cc:299] Negotiation successful
0806 10:46:10.804412 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":372,"threads_started":1}
I20260806 10:46:10.809510 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:10.812064 14187 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b00a4b3aa24d2f9a3b43ff5db2b175" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38739 } }
I20260806 10:46:10.812424 14187 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:10.812528 14187 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9b00a4b3aa24d2f9a3b43ff5db2b175, State: Initialized, Role: FOLLOWER
I20260806 10:46:10.813174 14187 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b00a4b3aa24d2f9a3b43ff5db2b175" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38739 } }
I20260806 10:46:10.813405 14187 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:10.813531 14187 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:10.813666 14187 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:10.816165 14187 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b00a4b3aa24d2f9a3b43ff5db2b175" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38739 } }
I20260806 10:46:10.816646 14187 leader_election.cc:302] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9b00a4b3aa24d2f9a3b43ff5db2b175; no voters:
I20260806 10:46:10.817287 14187 leader_election.cc:288] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:10.817420 14199 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:10.818586 14199 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [term 1 LEADER]: Becoming Leader. State: Replica: c9b00a4b3aa24d2f9a3b43ff5db2b175, State: Running, Role: LEADER
I20260806 10:46:10.819190 14199 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b00a4b3aa24d2f9a3b43ff5db2b175" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38739 } }
I20260806 10:46:10.819622 14187 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:10.822579 14200 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9b00a4b3aa24d2f9a3b43ff5db2b175" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b00a4b3aa24d2f9a3b43ff5db2b175" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38739 } } }
I20260806 10:46:10.823068 14200 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:10.822213 14201 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9b00a4b3aa24d2f9a3b43ff5db2b175. Latest consensus state: current_term: 1 leader_uuid: "c9b00a4b3aa24d2f9a3b43ff5db2b175" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9b00a4b3aa24d2f9a3b43ff5db2b175" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38739 } } }
I20260806 10:46:10.823494 14201 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:10.831315 14208 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:10.831691 14190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:10.814204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43461 (local address 127.0.0.1:38739)
0806 10:46:10.814382 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:10.814387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:10.814857 (+ 470us) server_negotiation.cc:407] Connection header received
0806 10:46:10.815024 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:10.815030 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:10.815104 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:10.815194 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:10.816591 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:10.817451 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:10.819126 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:10.819725 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:10.819857 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:10.823829 (+ 3972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:10.823839 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:10.823844 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:10.823882 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:10.827804 (+ 3922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:10.828969 (+ 1165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:10.828976 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:10.828981 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:10.829134 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:10.829710 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:10.829715 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:10.829719 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:10.830158 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:10.830475 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:10.831154 (+ 679us) server_negotiation.cc:299] Negotiation successful
0806 10:46:10.831351 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 10:46:10.836545 14208 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:10.846632 14208 catalog_manager.cc:1347] Generated new cluster ID: 17186c5170b6440780d8ed7f94ba8efe
I20260806 10:46:10.846760 14208 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:10.858753 14208 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:10.860137 14208 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:10.873008 14208 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9b00a4b3aa24d2f9a3b43ff5db2b175: Generated new TSK 0
I20260806 10:46:10.873911 14208 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:10.885550 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 14104
I20260806 10:46:10.886879 14181 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:10.977097 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 14104
W20260806 10:46:10.995858 14084 connection.cc:535] client connection to 127.0.0.1:38739 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38739): Connection reset by peer (error 104)
2026-08-06T10:46:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2175 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:11 dist-test-slave-fgb3 krb5kdc[14222](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:11 dist-test-slave-fgb3 krb5kdc[14222](info): set up 2 sockets
Aug 06 10:46:11 dist-test-slave-fgb3 krb5kdc[14222](info): commencing operation
krb5kdc: starting...
W20260806 10:46:12.182452 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:12 dist-test-slave-fgb3 krb5kdc[14222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013172, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 10:46:12.477492 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36837
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:12.809723 14239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:12.810021 14239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:12.810159 14239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:12.817309 14239 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:12.817430 14239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:12.817514 14239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:12.817606 14239 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:12.817668 14239 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:12.827368 14239 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36837
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:12.828580 14239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:12.829794 14239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:12.840904 14246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:12.840869 14247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:12.840950 14253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:12.841621 14239 server_base.cc:1034] running on GCE node
I20260806 10:46:12.842360 14239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:12.843667 14239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:12.844873 14239 hybrid_clock.cc:648] HybridClock initialized: now 1786013172844815 us; error 45 us; skew 500 ppm
I20260806 10:46:12.845235 14239 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:12 dist-test-slave-fgb3 krb5kdc[14222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013172, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:12.848254 14239 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 10:46:12.849596 14239 webserver.cc:460] Webserver started at http://127.0.0.1:42955/ using document root <none> and password file <none>
I20260806 10:46:12.850234 14239 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:12.850379 14239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:12.850663 14239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:12.853577 14239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "96c4b4c0349f404b92f3fe75fd7d07b9"
format_stamp: "Formatted at 2026-08-06 10:46:12 on dist-test-slave-fgb3"
server_key: "70923fd14fa6cd9b39c8ee77cf744182"
server_key_iv: "791af9ba4d9856a895c992ae49157c79"
server_key_version: "encryptionkey@0"
I20260806 10:46:12.854357 14239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "96c4b4c0349f404b92f3fe75fd7d07b9"
format_stamp: "Formatted at 2026-08-06 10:46:12 on dist-test-slave-fgb3"
server_key: "70923fd14fa6cd9b39c8ee77cf744182"
server_key_iv: "791af9ba4d9856a895c992ae49157c79"
server_key_version: "encryptionkey@0"
I20260806 10:46:12.859498 14239 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 10:46:12.862844 14261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:12.864234 14239 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260806 10:46:12.864409 14239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "96c4b4c0349f404b92f3fe75fd7d07b9"
format_stamp: "Formatted at 2026-08-06 10:46:12 on dist-test-slave-fgb3"
server_key: "70923fd14fa6cd9b39c8ee77cf744182"
server_key_iv: "791af9ba4d9856a895c992ae49157c79"
server_key_version: "encryptionkey@0"
I20260806 10:46:12.864593 14239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:12.887264 14239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:12.891703 14239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:12.891983 14239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:12.909778 14239 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36837
I20260806 10:46:12.909819 14335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36837 every 8 connection(s)
I20260806 10:46:12.911175 14239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:12.914767 14336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:12.916867 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 14239
I20260806 10:46:12.917061 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:12.917575 16565 external_mini_cluster.cc:1428] Setting key 5ab815fb658ce7b113e2c45de55e6ba8
I20260806 10:46:12.926775 14336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9: Bootstrap starting.
I20260806 10:46:12.930190 14336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:12.930671 14339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:12.919365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44317 (local address 127.0.0.1:36837)
0806 10:46:12.920170 (+ 805us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:12.920185 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:12.920228 (+ 43us) server_negotiation.cc:407] Connection header received
0806 10:46:12.921878 (+ 1650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:12.921907 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:12.922301 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:12.922643 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:12.923216 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:12.924596 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:12.926417 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:12.927089 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:12.927216 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:12.928464 (+ 1248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:12.928471 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:12.928483 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:12.929000 (+ 517us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:12.929077 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:12.929101 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:12.929210 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:12.929486 (+ 276us) server_negotiation.cc:299] Negotiation successful
0806 10:46:12.929652 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":369,"threads_started":1}
I20260806 10:46:12.931450 14336 log.cc:824] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:12.934485 14336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9: No bootstrap required, opened a new log
I20260806 10:46:12.934594 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:12.943037 14336 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96c4b4c0349f404b92f3fe75fd7d07b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36837 } }
I20260806 10:46:12.943468 14336 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:12.943584 14336 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96c4b4c0349f404b92f3fe75fd7d07b9, State: Initialized, Role: FOLLOWER
I20260806 10:46:12.944247 14336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96c4b4c0349f404b92f3fe75fd7d07b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36837 } }
I20260806 10:46:12.944541 14336 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:12.944698 14336 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:12.944873 14336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:12.945449 14339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:12.938876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39493 (local address 127.0.0.1:36837)
0806 10:46:12.939076 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:12.939082 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:12.939420 (+ 338us) server_negotiation.cc:407] Connection header received
0806 10:46:12.939591 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:12.939595 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:12.939651 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:12.939735 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:12.940319 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:12.941129 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:12.942993 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:12.943432 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:12.943549 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:12.944695 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:12.944699 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:12.944702 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:12.944720 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:12.944779 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:12.944802 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:12.944906 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:12.945096 (+ 190us) server_negotiation.cc:299] Negotiation successful
0806 10:46:12.945141 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 10:46:12.947376 14336 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96c4b4c0349f404b92f3fe75fd7d07b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36837 } }
I20260806 10:46:12.947842 14336 leader_election.cc:302] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96c4b4c0349f404b92f3fe75fd7d07b9; no voters:
I20260806 10:46:12.948380 14336 leader_election.cc:288] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:12.948503 14347 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:12.949127 14347 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [term 1 LEADER]: Becoming Leader. State: Replica: 96c4b4c0349f404b92f3fe75fd7d07b9, State: Running, Role: LEADER
I20260806 10:46:12.949633 14347 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96c4b4c0349f404b92f3fe75fd7d07b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36837 } }
I20260806 10:46:12.950491 14336 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:12.952754 14350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96c4b4c0349f404b92f3fe75fd7d07b9. Latest consensus state: current_term: 1 leader_uuid: "96c4b4c0349f404b92f3fe75fd7d07b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96c4b4c0349f404b92f3fe75fd7d07b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36837 } } }
I20260806 10:46:12.953189 14350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:12.952780 14348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96c4b4c0349f404b92f3fe75fd7d07b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96c4b4c0349f404b92f3fe75fd7d07b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36837 } } }
I20260806 10:46:12.953708 14348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:12.955170 14358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:12.960685 14358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:12.969813 14358 catalog_manager.cc:1347] Generated new cluster ID: 41940011657e4f188eb3ea618c7e2ef4
I20260806 10:46:12.969940 14358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:12.986049 14358 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:12.987349 14358 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:13.000486 14358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96c4b4c0349f404b92f3fe75fd7d07b9: Generated new TSK 0
I20260806 10:46:13.001452 14358 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:13.018806 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 14239
W20260806 10:46:13.019981 14327 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44317
W20260806 10:46:13.020690 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 14239: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:46:13.020881 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 14239
W20260806 10:46:13.044586 14220 connection.cc:535] client connection to 127.0.0.1:36837 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36837): Connection reset by peer (error 104)
2026-08-06T10:46:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2048 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:13 dist-test-slave-fgb3 krb5kdc[14374](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:13 dist-test-slave-fgb3 krb5kdc[14374](info): set up 2 sockets
Aug 06 10:46:13 dist-test-slave-fgb3 krb5kdc[14374](info): commencing operation
krb5kdc: starting...
W20260806 10:46:14.227626 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:14 dist-test-slave-fgb3 krb5kdc[14374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013174, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 10:46:14.533531 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36323
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36323
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:14.863798 14390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:14.864111 14390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:14.864205 14390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:14.871649 14390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:14.871767 14390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:14.871820 14390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:14.871884 14390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:14.871928 14390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:14.882517 14390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36323
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:14.883777 14390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:14.885048 14390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:14.896668 14401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:14.896785 14398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:14.896744 14399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:14.897627 14390 server_base.cc:1034] running on GCE node
I20260806 10:46:14.898510 14390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:14.899968 14390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:14.901196 14390 hybrid_clock.cc:648] HybridClock initialized: now 1786013174901145 us; error 45 us; skew 500 ppm
I20260806 10:46:14.901547 14390 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:14 dist-test-slave-fgb3 krb5kdc[14374](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013174, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:14.904953 14390 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 10:46:14.906522 14390 webserver.cc:460] Webserver started at http://127.0.0.1:40741/ using document root <none> and password file <none>
I20260806 10:46:14.907184 14390 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:14.907285 14390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:14.907545 14390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:14.910662 14390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "d2873d029ea04477a3c0e46f011392cc"
format_stamp: "Formatted at 2026-08-06 10:46:14 on dist-test-slave-fgb3"
server_key: "db0f62604aaac3d9ae8b4898325d7602"
server_key_iv: "cbe6d04a283c3dfccae5c805e62c5671"
server_key_version: "encryptionkey@0"
I20260806 10:46:14.911410 14390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "d2873d029ea04477a3c0e46f011392cc"
format_stamp: "Formatted at 2026-08-06 10:46:14 on dist-test-slave-fgb3"
server_key: "db0f62604aaac3d9ae8b4898325d7602"
server_key_iv: "cbe6d04a283c3dfccae5c805e62c5671"
server_key_version: "encryptionkey@0"
I20260806 10:46:14.916476 14390 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260806 10:46:14.919849 14413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:14.921092 14390 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 10:46:14.921223 14390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "d2873d029ea04477a3c0e46f011392cc"
format_stamp: "Formatted at 2026-08-06 10:46:14 on dist-test-slave-fgb3"
server_key: "db0f62604aaac3d9ae8b4898325d7602"
server_key_iv: "cbe6d04a283c3dfccae5c805e62c5671"
server_key_version: "encryptionkey@0"
I20260806 10:46:14.921397 14390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:14.927275 14390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:14.931095 14390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:14.931334 14390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:14.949147 14390 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36323
I20260806 10:46:14.949193 14487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36323 every 8 connection(s)
I20260806 10:46:14.950688 14390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:14.953976 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 14390
I20260806 10:46:14.954167 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:14.954722 14489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:14.954798 16565 external_mini_cluster.cc:1428] Setting key f125484a6080e9f384a162b218775c28
I20260806 10:46:14.962824 14492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:14.956546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38575 (local address 127.0.0.1:36323)
0806 10:46:14.957314 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:14.957325 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:14.957371 (+ 46us) server_negotiation.cc:407] Connection header received
0806 10:46:14.959386 (+ 2015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:14.959408 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:14.959745 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:14.960085 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:14.961215 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:14.961222 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:14.961234 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:14.961249 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:14.961318 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:14.961346 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:14.961523 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:14.961627 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 10:46:14.961806 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":334,"threads_started":1}
I20260806 10:46:14.966234 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:14.967938 14489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc: Bootstrap starting.
I20260806 10:46:14.971326 14489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:14.972507 14489 log.cc:824] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:14.972754 14492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:14.970367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33297 (local address 127.0.0.1:36323)
0806 10:46:14.970666 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:14.970672 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:14.970993 (+ 321us) server_negotiation.cc:407] Connection header received
0806 10:46:14.971115 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:14.971120 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:14.971180 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:14.971304 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:14.972102 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:14.972108 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:14.972112 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:14.972129 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:14.972182 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:14.972201 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:14.972336 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:14.972381 (+ 45us) server_negotiation.cc:299] Negotiation successful
0806 10:46:14.972434 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
I20260806 10:46:14.975361 14489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc: No bootstrap required, opened a new log
I20260806 10:46:14.982932 14489 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2873d029ea04477a3c0e46f011392cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36323 } }
I20260806 10:46:14.983289 14489 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:14.983371 14489 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2873d029ea04477a3c0e46f011392cc, State: Initialized, Role: FOLLOWER
I20260806 10:46:14.983918 14489 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2873d029ea04477a3c0e46f011392cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36323 } }
I20260806 10:46:14.984172 14489 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:14.984329 14489 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:14.984488 14489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:14.986686 14489 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2873d029ea04477a3c0e46f011392cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36323 } }
I20260806 10:46:14.987150 14489 leader_election.cc:302] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2873d029ea04477a3c0e46f011392cc; no voters:
I20260806 10:46:14.987722 14489 leader_election.cc:288] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:14.987848 14505 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:14.988462 14505 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [term 1 LEADER]: Becoming Leader. State: Replica: d2873d029ea04477a3c0e46f011392cc, State: Running, Role: LEADER
I20260806 10:46:14.988982 14505 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2873d029ea04477a3c0e46f011392cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36323 } }
I20260806 10:46:14.989655 14489 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:14.992208 14507 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2873d029ea04477a3c0e46f011392cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2873d029ea04477a3c0e46f011392cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36323 } } }
I20260806 10:46:14.992579 14507 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:14.992992 14508 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2873d029ea04477a3c0e46f011392cc. Latest consensus state: current_term: 1 leader_uuid: "d2873d029ea04477a3c0e46f011392cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2873d029ea04477a3c0e46f011392cc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36323 } } }
I20260806 10:46:14.993575 14508 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:14.994438 14515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:14.999549 14515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:15.008139 14515 catalog_manager.cc:1347] Generated new cluster ID: 7c68a37297c74a4686eabbb90a54a00f
I20260806 10:46:15.008260 14515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:15.016713 14515 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:15.017206 14515 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:15.037864 14515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2873d029ea04477a3c0e46f011392cc: Generated new TSK 0
I20260806 10:46:15.038936 14515 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:15.044644 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 14390
W20260806 10:46:15.045955 14480 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38575
W20260806 10:46:15.046731 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 14390: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:46:15.046871 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 14390
2026-08-06T10:46:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2025 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:15 dist-test-slave-fgb3 krb5kdc[14538](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:15 dist-test-slave-fgb3 krb5kdc[14538](info): set up 2 sockets
Aug 06 10:46:15 dist-test-slave-fgb3 krb5kdc[14538](info): commencing operation
krb5kdc: starting...
W20260806 10:46:16.262512 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.006s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:16 dist-test-slave-fgb3 krb5kdc[14538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 10:46:16.565858 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44549
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44549
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:16.899444 14558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:16.899744 14558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:16.899881 14558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:16.907063 14558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:16.907176 14558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:16.907248 14558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:16.907326 14558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:16.907397 14558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:16.917098 14558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:16.918452 14558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:16.919742 14558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:16.931294 14565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:16.931361 14566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:16.931265 14568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:16.932246 14558 server_base.cc:1034] running on GCE node
I20260806 10:46:16.932977 14558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:16.934332 14558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:16.935542 14558 hybrid_clock.cc:648] HybridClock initialized: now 1786013176935499 us; error 37 us; skew 500 ppm
I20260806 10:46:16.935863 14558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:16 dist-test-slave-fgb3 krb5kdc[14538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013176, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:16.938889 14558 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 10:46:16.940402 14558 webserver.cc:460] Webserver started at http://127.0.0.1:35191/ using document root <none> and password file <none>
I20260806 10:46:16.941066 14558 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:16.941182 14558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:16.941473 14558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:16.944401 14558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "9d95394993bb48f29e165c6005784794"
format_stamp: "Formatted at 2026-08-06 10:46:16 on dist-test-slave-fgb3"
server_key: "e41f5a4bcb180feb1060ba390236f4c0"
server_key_iv: "528b44345b23e90ac2316865f5e04bc9"
server_key_version: "encryptionkey@0"
I20260806 10:46:16.945142 14558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "9d95394993bb48f29e165c6005784794"
format_stamp: "Formatted at 2026-08-06 10:46:16 on dist-test-slave-fgb3"
server_key: "e41f5a4bcb180feb1060ba390236f4c0"
server_key_iv: "528b44345b23e90ac2316865f5e04bc9"
server_key_version: "encryptionkey@0"
I20260806 10:46:16.950052 14558 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:46:16.953289 14576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:16.954578 14558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:46:16.954738 14558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "9d95394993bb48f29e165c6005784794"
format_stamp: "Formatted at 2026-08-06 10:46:16 on dist-test-slave-fgb3"
server_key: "e41f5a4bcb180feb1060ba390236f4c0"
server_key_iv: "528b44345b23e90ac2316865f5e04bc9"
server_key_version: "encryptionkey@0"
I20260806 10:46:16.954902 14558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:16.998468 14558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:17.002780 14558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:17.003062 14558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:17.021550 14558 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44549
I20260806 10:46:17.021586 14641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44549 every 8 connection(s)
I20260806 10:46:17.023044 14558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:17.026780 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 14558
I20260806 10:46:17.026966 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:17.026983 14642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:17.027421 16565 external_mini_cluster.cc:1428] Setting key ce357061e13225c13a4a9013281cdeea
I20260806 10:46:17.041513 14642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794: Bootstrap starting.
Aug 06 10:46:17 dist-test-slave-fgb3 krb5kdc[14538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 10:46:17.045413 14642 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:17.046542 14642 log.cc:824] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:17.049327 14642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794: No bootstrap required, opened a new log
I20260806 10:46:17.051106 14646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:17.029208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39901 (local address 127.0.0.1:44549)
0806 10:46:17.030107 (+ 899us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:17.030123 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:17.030174 (+ 51us) server_negotiation.cc:407] Connection header received
0806 10:46:17.031979 (+ 1805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:17.032010 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:17.032531 (+ 521us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:17.032983 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:17.034431 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:17.036404 (+ 1973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:17.037740 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:17.038882 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:17.039075 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:17.043407 (+ 4332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:17.043418 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:17.043438 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:17.043491 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:17.047061 (+ 3570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:17.047769 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:17.047776 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:17.047782 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:17.047954 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:17.048348 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:17.048351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:17.048353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:17.048875 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:17.049145 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:17.049631 (+ 486us) server_negotiation.cc:299] Negotiation successful
0806 10:46:17.050039 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":372,"threads_started":1}
I20260806 10:46:17.054953 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:17.057833 14642 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d95394993bb48f29e165c6005784794" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44549 } }
I20260806 10:46:17.058248 14642 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:17.058374 14642 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d95394993bb48f29e165c6005784794, State: Initialized, Role: FOLLOWER
I20260806 10:46:17.059134 14642 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d95394993bb48f29e165c6005784794" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44549 } }
I20260806 10:46:17.059518 14642 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:17.059657 14642 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:17.059832 14642 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:17.062081 14642 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d95394993bb48f29e165c6005784794" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44549 } }
I20260806 10:46:17.062623 14642 leader_election.cc:302] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d95394993bb48f29e165c6005784794; no voters:
I20260806 10:46:17.063249 14642 leader_election.cc:288] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:17.063364 14656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:17.063949 14656 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [term 1 LEADER]: Becoming Leader. State: Replica: 9d95394993bb48f29e165c6005784794, State: Running, Role: LEADER
I20260806 10:46:17.064694 14656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d95394993bb48f29e165c6005784794" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44549 } }
I20260806 10:46:17.066593 14642 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:17.067749 14657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d95394993bb48f29e165c6005784794. Latest consensus state: current_term: 1 leader_uuid: "9d95394993bb48f29e165c6005784794" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d95394993bb48f29e165c6005784794" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44549 } } }
I20260806 10:46:17.068261 14657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:17.068048 14659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d95394993bb48f29e165c6005784794" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d95394993bb48f29e165c6005784794" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44549 } } }
I20260806 10:46:17.068384 14659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:17.069934 14663 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:17.074170 14646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:17.059199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36977 (local address 127.0.0.1:44549)
0806 10:46:17.059395 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:17.059401 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:17.059796 (+ 395us) server_negotiation.cc:407] Connection header received
0806 10:46:17.059976 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:17.059981 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:17.060046 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:17.060137 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:17.061598 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:17.062308 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:17.063644 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:17.064309 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:17.064438 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:17.067258 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:17.067264 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:17.067269 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:17.067310 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:17.071116 (+ 3806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:17.071818 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:17.071824 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:17.071828 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:17.072076 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:17.072557 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:17.072561 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:17.072563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:17.072983 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:17.073227 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:17.073572 (+ 345us) server_negotiation.cc:299] Negotiation successful
0806 10:46:17.073793 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:46:17.081243 14663 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:17.089834 14663 catalog_manager.cc:1347] Generated new cluster ID: f832cd71b8c446e6b1190b3c8fdb5f3e
I20260806 10:46:17.089962 14663 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:17.109655 14663 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:17.111254 14663 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:17.119300 14663 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d95394993bb48f29e165c6005784794: Generated new TSK 0
I20260806 10:46:17.120393 14663 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:17.136390 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 14558
I20260806 10:46:17.137575 14635 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:17.230221 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 14558
2026-08-06T10:46:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2184 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:17 dist-test-slave-fgb3 krb5kdc[14687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:17 dist-test-slave-fgb3 krb5kdc[14687](info): set up 2 sockets
Aug 06 10:46:17 dist-test-slave-fgb3 krb5kdc[14687](info): commencing operation
krb5kdc: starting...
W20260806 10:46:18.440595 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:18 dist-test-slave-fgb3 krb5kdc[14687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 10:46:18.754053 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39823
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:19.093279 14703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:19.093591 14703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:19.093724 14703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:19.101027 14703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:19.101157 14703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:19.101233 14703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:19.101315 14703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:19.101379 14703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:19.112226 14703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:19.113559 14703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:19.114916 14703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:19.126526 14710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:19.126502 14711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:19.126459 14714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:19.127276 14703 server_base.cc:1034] running on GCE node
I20260806 10:46:19.128064 14703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:19.129505 14703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:19.130744 14703 hybrid_clock.cc:648] HybridClock initialized: now 1786013179130688 us; error 49 us; skew 500 ppm
I20260806 10:46:19.131139 14703 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:19 dist-test-slave-fgb3 krb5kdc[14687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013179, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:19.139889 14703 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 10:46:19.141469 14703 webserver.cc:460] Webserver started at http://127.0.0.1:38853/ using document root <none> and password file <none>
I20260806 10:46:19.142151 14703 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:19.142277 14703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:19.142604 14703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:19.145599 14703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "1010828e03d04894842b466e5a0cfb95"
format_stamp: "Formatted at 2026-08-06 10:46:19 on dist-test-slave-fgb3"
server_key: "85f2996ca917089405f2020d94226998"
server_key_iv: "f8c5b86b3bf9e4d975b16869b399cec1"
server_key_version: "encryptionkey@0"
I20260806 10:46:19.146406 14703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "1010828e03d04894842b466e5a0cfb95"
format_stamp: "Formatted at 2026-08-06 10:46:19 on dist-test-slave-fgb3"
server_key: "85f2996ca917089405f2020d94226998"
server_key_iv: "f8c5b86b3bf9e4d975b16869b399cec1"
server_key_version: "encryptionkey@0"
I20260806 10:46:19.151448 14703 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 10:46:19.154731 14722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:19.155951 14703 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 10:46:19.156111 14703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "1010828e03d04894842b466e5a0cfb95"
format_stamp: "Formatted at 2026-08-06 10:46:19 on dist-test-slave-fgb3"
server_key: "85f2996ca917089405f2020d94226998"
server_key_iv: "f8c5b86b3bf9e4d975b16869b399cec1"
server_key_version: "encryptionkey@0"
I20260806 10:46:19.156279 14703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:19.181250 14703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:19.185572 14703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:19.185844 14703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:19.203689 14703 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39823
I20260806 10:46:19.203722 14787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39823 every 8 connection(s)
I20260806 10:46:19.205137 14703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:19.209105 14788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:19.215049 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 14703
I20260806 10:46:19.215265 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:19.215795 16565 external_mini_cluster.cc:1428] Setting key afd8b346833d22be2fd82827be0843b2
I20260806 10:46:19.220830 14788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95: Bootstrap starting.
I20260806 10:46:19.224507 14788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:19.225684 14788 log.cc:824] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:19.228837 14788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95: No bootstrap required, opened a new log
I20260806 10:46:19.229583 14791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:19.217842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44129 (local address 127.0.0.1:39823)
0806 10:46:19.218750 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:19.218770 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:19.218823 (+ 53us) server_negotiation.cc:407] Connection header received
0806 10:46:19.220525 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:19.220548 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:19.220956 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:19.221312 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:19.221910 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:19.223295 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:19.225142 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:19.225869 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:19.226008 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:19.227281 (+ 1273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:19.227292 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:19.227308 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:19.227925 (+ 617us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:19.228003 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:19.228028 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:19.228120 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:19.228336 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 10:46:19.228584 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":444,"threads_started":1}
I20260806 10:46:19.233098 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:19.238113 14788 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1010828e03d04894842b466e5a0cfb95" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39823 } }
I20260806 10:46:19.238603 14788 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:19.238709 14788 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1010828e03d04894842b466e5a0cfb95, State: Initialized, Role: FOLLOWER
I20260806 10:46:19.239312 14788 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1010828e03d04894842b466e5a0cfb95" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39823 } }
I20260806 10:46:19.239549 14788 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:19.239681 14788 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:19.239853 14788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:19.242084 14788 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1010828e03d04894842b466e5a0cfb95" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39823 } }
I20260806 10:46:19.242599 14788 leader_election.cc:302] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1010828e03d04894842b466e5a0cfb95; no voters:
I20260806 10:46:19.243207 14788 leader_election.cc:288] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:19.243307 14802 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:19.244635 14791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:19.238216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59991 (local address 127.0.0.1:39823)
0806 10:46:19.238416 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:19.238422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:19.238924 (+ 502us) server_negotiation.cc:407] Connection header received
0806 10:46:19.239102 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:19.239106 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:19.239168 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:19.239261 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:19.239845 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:19.240604 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:19.241949 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:19.242515 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:19.242643 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:19.243704 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:19.243714 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:19.243718 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:19.243744 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:19.243796 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:19.243820 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:19.243920 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:19.244148 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 10:46:19.244266 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 10:46:19.244527 14802 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [term 1 LEADER]: Becoming Leader. State: Replica: 1010828e03d04894842b466e5a0cfb95, State: Running, Role: LEADER
I20260806 10:46:19.245174 14802 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1010828e03d04894842b466e5a0cfb95" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39823 } }
I20260806 10:46:19.245529 14788 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:19.248008 14804 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1010828e03d04894842b466e5a0cfb95. Latest consensus state: current_term: 1 leader_uuid: "1010828e03d04894842b466e5a0cfb95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1010828e03d04894842b466e5a0cfb95" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39823 } } }
I20260806 10:46:19.248060 14803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1010828e03d04894842b466e5a0cfb95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1010828e03d04894842b466e5a0cfb95" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39823 } } }
I20260806 10:46:19.248440 14803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:19.248446 14804 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:19.249325 14807 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:19.257802 14807 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:19.266757 14807 catalog_manager.cc:1347] Generated new cluster ID: 4bb43b856add4243a169f0ab7ced33bb
I20260806 10:46:19.266868 14807 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:19.286967 14807 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:19.288545 14807 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:19.307792 14807 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1010828e03d04894842b466e5a0cfb95: Generated new TSK 0
I20260806 10:46:19.308699 14807 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:19.317251 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 14703
W20260806 10:46:19.318802 14782 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44129
W20260806 10:46:19.319504 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 14703: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:46:19.319649 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 14703
2026-08-06T10:46:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2090 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:19 dist-test-slave-fgb3 krb5kdc[14827](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:19 dist-test-slave-fgb3 krb5kdc[14827](info): set up 2 sockets
Aug 06 10:46:19 dist-test-slave-fgb3 krb5kdc[14827](info): commencing operation
krb5kdc: starting...
W20260806 10:46:20.532366 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:20 dist-test-slave-fgb3 krb5kdc[14827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 10:46:20.843410 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39809
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39809
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:21.187085 14848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:21.187410 14848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:21.187549 14848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:21.194993 14848 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:21.195122 14848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:21.195204 14848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:21.195295 14848 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:21.195355 14848 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:21.205607 14848 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39809
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:21.207017 14848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:21.208437 14848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:21.220857 14859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:21.220835 14862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:21.220921 14860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:21.222204 14848 server_base.cc:1034] running on GCE node
I20260806 10:46:21.223126 14848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:21.224668 14848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:21.225912 14848 hybrid_clock.cc:648] HybridClock initialized: now 1786013181225853 us; error 49 us; skew 500 ppm
I20260806 10:46:21.226372 14848 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:21 dist-test-slave-fgb3 krb5kdc[14827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013181, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:21.229672 14848 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 10:46:21.231307 14848 webserver.cc:460] Webserver started at http://127.0.0.1:34893/ using document root <none> and password file <none>
I20260806 10:46:21.232017 14848 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:21.232151 14848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:21.232462 14848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:21.235710 14848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "72dbc4102c334aeb805b395aa8d8b701"
format_stamp: "Formatted at 2026-08-06 10:46:21 on dist-test-slave-fgb3"
server_key: "e34fa236d867fbd312a5450c16f7bfdf"
server_key_iv: "1556357105c797c2a0f72db062292fa1"
server_key_version: "encryptionkey@0"
I20260806 10:46:21.236613 14848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "72dbc4102c334aeb805b395aa8d8b701"
format_stamp: "Formatted at 2026-08-06 10:46:21 on dist-test-slave-fgb3"
server_key: "e34fa236d867fbd312a5450c16f7bfdf"
server_key_iv: "1556357105c797c2a0f72db062292fa1"
server_key_version: "encryptionkey@0"
I20260806 10:46:21.242385 14848 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 10:46:21.246477 14870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:21.247876 14848 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:46:21.248067 14848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "72dbc4102c334aeb805b395aa8d8b701"
format_stamp: "Formatted at 2026-08-06 10:46:21 on dist-test-slave-fgb3"
server_key: "e34fa236d867fbd312a5450c16f7bfdf"
server_key_iv: "1556357105c797c2a0f72db062292fa1"
server_key_version: "encryptionkey@0"
I20260806 10:46:21.248265 14848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:21.254374 14848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:21.258648 14848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:21.258929 14848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:21.278334 14848 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39809
I20260806 10:46:21.278429 14936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39809 every 8 connection(s)
I20260806 10:46:21.279729 14848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:21.283422 14937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:21.284036 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 14848
I20260806 10:46:21.284255 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:21.284793 16565 external_mini_cluster.cc:1428] Setting key c965881cf24dd1f9388f6f263cdd95f5
I20260806 10:46:21.293910 14941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:21.286686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35865 (local address 127.0.0.1:39809)
0806 10:46:21.287547 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:21.287562 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:21.287623 (+ 61us) server_negotiation.cc:407] Connection header received
0806 10:46:21.290103 (+ 2480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:21.290140 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:21.290658 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:21.291115 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:21.292043 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:21.292051 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:21.292067 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:21.292082 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:21.292146 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:21.292177 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:21.292395 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:21.292513 (+ 118us) server_negotiation.cc:299] Negotiation successful
0806 10:46:21.292701 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":349,"threads_started":1}
I20260806 10:46:21.297508 14937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701: Bootstrap starting.
I20260806 10:46:21.297696 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:21.300625 14937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:21.301716 14937 log.cc:824] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:21.304563 14941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:21.301997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37561 (local address 127.0.0.1:39809)
0806 10:46:21.302166 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:21.302172 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:21.302628 (+ 456us) server_negotiation.cc:407] Connection header received
0806 10:46:21.302796 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:21.302800 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:21.302851 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:21.302946 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:21.303867 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:21.303872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:21.303877 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:21.303895 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:21.303939 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:21.303959 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:21.304082 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:21.304191 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 10:46:21.304250 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 10:46:21.305069 14937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701: No bootstrap required, opened a new log
I20260806 10:46:21.313146 14937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72dbc4102c334aeb805b395aa8d8b701" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39809 } }
I20260806 10:46:21.313683 14937 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:21.313804 14937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72dbc4102c334aeb805b395aa8d8b701, State: Initialized, Role: FOLLOWER
I20260806 10:46:21.314493 14937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72dbc4102c334aeb805b395aa8d8b701" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39809 } }
I20260806 10:46:21.314791 14937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:21.314942 14937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:21.315117 14937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:21.318121 14937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72dbc4102c334aeb805b395aa8d8b701" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39809 } }
I20260806 10:46:21.318651 14937 leader_election.cc:302] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72dbc4102c334aeb805b395aa8d8b701; no voters:
I20260806 10:46:21.319216 14937 leader_election.cc:288] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:21.319391 14951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:21.320016 14951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [term 1 LEADER]: Becoming Leader. State: Replica: 72dbc4102c334aeb805b395aa8d8b701, State: Running, Role: LEADER
I20260806 10:46:21.320544 14951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72dbc4102c334aeb805b395aa8d8b701" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39809 } }
I20260806 10:46:21.321419 14937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:21.323586 14954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72dbc4102c334aeb805b395aa8d8b701. Latest consensus state: current_term: 1 leader_uuid: "72dbc4102c334aeb805b395aa8d8b701" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72dbc4102c334aeb805b395aa8d8b701" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39809 } } }
I20260806 10:46:21.323990 14954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:21.324725 14952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72dbc4102c334aeb805b395aa8d8b701" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72dbc4102c334aeb805b395aa8d8b701" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39809 } } }
I20260806 10:46:21.325115 14952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:21.325639 14960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:21.331346 14960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:21.340101 14960 catalog_manager.cc:1347] Generated new cluster ID: d177bc0e81dd4d9dbcb3a0042ad8ed45
I20260806 10:46:21.340231 14960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:21.368736 14960 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:21.369216 14960 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:21.381718 14960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72dbc4102c334aeb805b395aa8d8b701: Generated new TSK 0
I20260806 10:46:21.382709 14960 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:21.399864 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 14848
W20260806 10:46:21.401124 14928 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:35865
W20260806 10:46:21.401892 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 14848: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:46:21.402056 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 14848
2026-08-06T10:46:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2083 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:21 dist-test-slave-fgb3 krb5kdc[14976](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:21 dist-test-slave-fgb3 krb5kdc[14976](info): set up 2 sockets
Aug 06 10:46:21 dist-test-slave-fgb3 krb5kdc[14976](info): commencing operation
krb5kdc: starting...
W20260806 10:46:22.627161 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.002s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:22 dist-test-slave-fgb3 krb5kdc[14976](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 10:46:22.948078 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43549
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43549
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:23.289168 14991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:23.289469 14991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:23.289569 14991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:23.296824 14991 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:23.296954 14991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:23.297004 14991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:23.297076 14991 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:23.297299 14991 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:23.307560 14991 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:23.308917 14991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:23.310269 14991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:23.323727 14998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:23.323802 15004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:23.323817 14999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:23.324605 14991 server_base.cc:1034] running on GCE node
I20260806 10:46:23.325394 14991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:23.326902 14991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:23.328119 14991 hybrid_clock.cc:648] HybridClock initialized: now 1786013183328063 us; error 48 us; skew 500 ppm
I20260806 10:46:23.328507 14991 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:23 dist-test-slave-fgb3 krb5kdc[14976](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013183, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:23.331677 14991 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 10:46:23.333205 14991 webserver.cc:460] Webserver started at http://127.0.0.1:36637/ using document root <none> and password file <none>
I20260806 10:46:23.333886 14991 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:23.334009 14991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:23.334339 14991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:23.337389 14991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "fc2e2a11251842c78f35d4862676cbc8"
format_stamp: "Formatted at 2026-08-06 10:46:23 on dist-test-slave-fgb3"
server_key: "d3e239df9d7d202fc9c27ac9dfd830af"
server_key_iv: "436712cf339617daf47cb60c3721b884"
server_key_version: "encryptionkey@0"
I20260806 10:46:23.338191 14991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "fc2e2a11251842c78f35d4862676cbc8"
format_stamp: "Formatted at 2026-08-06 10:46:23 on dist-test-slave-fgb3"
server_key: "d3e239df9d7d202fc9c27ac9dfd830af"
server_key_iv: "436712cf339617daf47cb60c3721b884"
server_key_version: "encryptionkey@0"
I20260806 10:46:23.343719 14991 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260806 10:46:23.347430 15013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:23.348796 14991 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 10:46:23.348989 14991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "fc2e2a11251842c78f35d4862676cbc8"
format_stamp: "Formatted at 2026-08-06 10:46:23 on dist-test-slave-fgb3"
server_key: "d3e239df9d7d202fc9c27ac9dfd830af"
server_key_iv: "436712cf339617daf47cb60c3721b884"
server_key_version: "encryptionkey@0"
I20260806 10:46:23.349200 14991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:23.385149 14991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:23.389750 14991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:23.390053 14991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:23.407910 14991 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43549
I20260806 10:46:23.407943 15082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43549 every 8 connection(s)
I20260806 10:46:23.409353 14991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:23.409888 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 14991
I20260806 10:46:23.410058 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:23.410653 16565 external_mini_cluster.cc:1428] Setting key f9c813f5b7570a05e3e850e3f5f21a85
I20260806 10:46:23.413918 15083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 10:46:23 dist-test-slave-fgb3 krb5kdc[14976](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 10:46:23.424944 15083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8: Bootstrap starting.
I20260806 10:46:23.428686 15083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:23.429869 15083 log.cc:824] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:23.433480 15083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8: No bootstrap required, opened a new log
I20260806 10:46:23.434366 15087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:23.412655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:58965 (local address 127.0.0.1:43549)
0806 10:46:23.413514 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:23.413527 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:23.413573 (+ 46us) server_negotiation.cc:407] Connection header received
0806 10:46:23.415416 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:23.415440 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:23.415838 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:23.416234 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:23.417871 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:23.419545 (+ 1674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:23.420874 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:23.421592 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:23.421780 (+ 188us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:23.426399 (+ 4619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:23.426410 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:23.426426 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:23.426492 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:23.429603 (+ 3111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:23.430747 (+ 1144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:23.430759 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:23.430768 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:23.431019 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:23.431513 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:23.431517 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:23.431519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:23.432062 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:23.432314 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:23.432853 (+ 539us) server_negotiation.cc:299] Negotiation successful
0806 10:46:23.433154 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":351,"threads_started":1}
I20260806 10:46:23.439255 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:23.444010 15083 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc2e2a11251842c78f35d4862676cbc8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43549 } }
I20260806 10:46:23.444583 15083 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:23.444705 15083 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2e2a11251842c78f35d4862676cbc8, State: Initialized, Role: FOLLOWER
I20260806 10:46:23.445454 15083 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc2e2a11251842c78f35d4862676cbc8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43549 } }
I20260806 10:46:23.445710 15083 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:23.445853 15083 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:23.446064 15083 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:23.448845 15083 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc2e2a11251842c78f35d4862676cbc8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43549 } }
I20260806 10:46:23.449479 15083 leader_election.cc:302] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc2e2a11251842c78f35d4862676cbc8; no voters:
I20260806 10:46:23.450111 15083 leader_election.cc:288] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:23.450289 15096 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:23.450987 15096 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [term 1 LEADER]: Becoming Leader. State: Replica: fc2e2a11251842c78f35d4862676cbc8, State: Running, Role: LEADER
I20260806 10:46:23.451665 15096 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc2e2a11251842c78f35d4862676cbc8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43549 } }
I20260806 10:46:23.453431 15083 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:23.455217 15098 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc2e2a11251842c78f35d4862676cbc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc2e2a11251842c78f35d4862676cbc8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43549 } } }
I20260806 10:46:23.455709 15098 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:23.464870 15087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:23.445121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:39245 (local address 127.0.0.1:43549)
0806 10:46:23.445306 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:23.445313 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:23.445779 (+ 466us) server_negotiation.cc:407] Connection header received
0806 10:46:23.445995 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:23.446000 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:23.446102 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:23.446227 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:23.447859 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:23.448948 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:23.450571 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:23.451386 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:23.451521 (+ 135us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:23.454940 (+ 3419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:23.454948 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:23.454953 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:23.454997 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:23.460108 (+ 5111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:23.461228 (+ 1120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:23.461234 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:23.461238 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:23.461427 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:23.462008 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:23.462014 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:23.462018 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:23.462498 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:23.462818 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:23.464226 (+ 1408us) server_negotiation.cc:299] Negotiation successful
0806 10:46:23.464452 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 10:46:23.457038 15097 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc2e2a11251842c78f35d4862676cbc8. Latest consensus state: current_term: 1 leader_uuid: "fc2e2a11251842c78f35d4862676cbc8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc2e2a11251842c78f35d4862676cbc8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43549 } } }
I20260806 10:46:23.468009 15097 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:23.468761 15104 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:23.473671 15104 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:23.483474 15104 catalog_manager.cc:1347] Generated new cluster ID: 7eff5989d30344dabe8cd98b9a15b190
I20260806 10:46:23.483600 15104 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:23.489866 15122 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 10:46:23.499966 15104 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:23.501281 15104 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:23.507550 15104 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc2e2a11251842c78f35d4862676cbc8: Generated new TSK 0
I20260806 10:46:23.508513 15104 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:23.521287 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 14991
I20260806 10:46:23.522732 15078 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:23.613415 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 14991
W20260806 10:46:23.635833 14974 connection.cc:535] client connection to 127.0.0.1:43549 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43549): Connection reset by peer (error 104)
2026-08-06T10:46:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2208 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:23 dist-test-slave-fgb3 krb5kdc[15130](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:23 dist-test-slave-fgb3 krb5kdc[15130](info): set up 2 sockets
Aug 06 10:46:23 dist-test-slave-fgb3 krb5kdc[15130](info): commencing operation
krb5kdc: starting...
W20260806 10:46:24.825913 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:25 dist-test-slave-fgb3 krb5kdc[15130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013185, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 10:46:25.144975 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44611
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:25.519237 15153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:25.519537 15153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:25.519634 15153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:25.526952 15153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:25.527074 15153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:25.527129 15153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:25.527190 15153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:25.527233 15153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:25.537243 15153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44611
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:25.538589 15153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:25.539891 15153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:25.552541 15158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:25.552577 15159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:25.552506 15161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:25.553421 15153 server_base.cc:1034] running on GCE node
I20260806 10:46:25.554262 15153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:25.555841 15153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:25.557075 15153 hybrid_clock.cc:648] HybridClock initialized: now 1786013185557021 us; error 38 us; skew 500 ppm
I20260806 10:46:25.557459 15153 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:25 dist-test-slave-fgb3 krb5kdc[15130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013185, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:25.564823 15153 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 10:46:25.566501 15153 webserver.cc:460] Webserver started at http://127.0.0.1:35969/ using document root <none> and password file <none>
I20260806 10:46:25.567220 15153 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:25.567344 15153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:25.567664 15153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:25.570796 15153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "7a285b05bc574515b32cf0e91fa784d2"
format_stamp: "Formatted at 2026-08-06 10:46:25 on dist-test-slave-fgb3"
server_key: "db2cf0eb965db6223c7ac3882f1c06e4"
server_key_iv: "ac0461c93a438a99004570c1313b0be8"
server_key_version: "encryptionkey@0"
I20260806 10:46:25.571583 15153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "7a285b05bc574515b32cf0e91fa784d2"
format_stamp: "Formatted at 2026-08-06 10:46:25 on dist-test-slave-fgb3"
server_key: "db2cf0eb965db6223c7ac3882f1c06e4"
server_key_iv: "ac0461c93a438a99004570c1313b0be8"
server_key_version: "encryptionkey@0"
I20260806 10:46:25.576787 15153 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 10:46:25.580420 15171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:25.581846 15153 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 10:46:25.582026 15153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "7a285b05bc574515b32cf0e91fa784d2"
format_stamp: "Formatted at 2026-08-06 10:46:25 on dist-test-slave-fgb3"
server_key: "db2cf0eb965db6223c7ac3882f1c06e4"
server_key_iv: "ac0461c93a438a99004570c1313b0be8"
server_key_version: "encryptionkey@0"
I20260806 10:46:25.582213 15153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:25.609681 15153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:25.613811 15153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:25.614097 15153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:25.632150 15153 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44611
I20260806 10:46:25.632184 15239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44611 every 8 connection(s)
I20260806 10:46:25.633530 15153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:25.637331 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 15153
I20260806 10:46:25.637341 15241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:25.637499 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:25.638002 16565 external_mini_cluster.cc:1428] Setting key f106dac1bc779c081650e9a205362cce
I20260806 10:46:25.651067 15241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2: Bootstrap starting.
I20260806 10:46:25.651567 15247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:25.639941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:36389 (local address 127.0.0.1:44611)
0806 10:46:25.640776 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:25.640788 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:25.640831 (+ 43us) server_negotiation.cc:407] Connection header received
0806 10:46:25.642371 (+ 1540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:25.642395 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:25.642801 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:25.643140 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:25.643734 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:25.645111 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:25.646917 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:25.647660 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:25.647814 (+ 154us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:25.649116 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:25.649124 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:25.649138 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:25.649717 (+ 579us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:25.649795 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:25.649830 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:25.649946 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:25.650289 (+ 343us) server_negotiation.cc:299] Negotiation successful
0806 10:46:25.650533 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":395,"threads_started":1}
I20260806 10:46:25.654253 15241 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:25.655268 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:25.655356 15241 log.cc:824] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:25.658746 15241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2: No bootstrap required, opened a new log
I20260806 10:46:25.667044 15247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:25.660351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:50571 (local address 127.0.0.1:44611)
0806 10:46:25.660541 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:25.660547 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:25.660935 (+ 388us) server_negotiation.cc:407] Connection header received
0806 10:46:25.661095 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:25.661101 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:25.661189 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:25.661297 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:25.661740 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:25.662928 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:25.664231 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:25.664940 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:25.665072 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:25.666230 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:25.666238 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:25.666243 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:25.666264 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:25.666343 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:25.666367 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:25.666491 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:25.666699 (+ 208us) server_negotiation.cc:299] Negotiation successful
0806 10:46:25.666758 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 10:46:25.668391 15241 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a285b05bc574515b32cf0e91fa784d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44611 } }
I20260806 10:46:25.668895 15241 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:25.668985 15241 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a285b05bc574515b32cf0e91fa784d2, State: Initialized, Role: FOLLOWER
I20260806 10:46:25.669550 15241 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a285b05bc574515b32cf0e91fa784d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44611 } }
I20260806 10:46:25.669785 15241 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:25.669893 15241 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:25.670022 15241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:25.672276 15241 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a285b05bc574515b32cf0e91fa784d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44611 } }
I20260806 10:46:25.672781 15241 leader_election.cc:302] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a285b05bc574515b32cf0e91fa784d2; no voters:
I20260806 10:46:25.673345 15241 leader_election.cc:288] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:25.673492 15254 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:25.675072 15254 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [term 1 LEADER]: Becoming Leader. State: Replica: 7a285b05bc574515b32cf0e91fa784d2, State: Running, Role: LEADER
I20260806 10:46:25.675750 15241 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:25.675707 15254 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a285b05bc574515b32cf0e91fa784d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44611 } }
I20260806 10:46:25.678521 15258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a285b05bc574515b32cf0e91fa784d2. Latest consensus state: current_term: 1 leader_uuid: "7a285b05bc574515b32cf0e91fa784d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a285b05bc574515b32cf0e91fa784d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44611 } } }
I20260806 10:46:25.679473 15255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a285b05bc574515b32cf0e91fa784d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a285b05bc574515b32cf0e91fa784d2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44611 } } }
I20260806 10:46:25.679782 15255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:25.680084 15258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:25.681797 15266 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:25.689977 15266 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:25.700124 15266 catalog_manager.cc:1347] Generated new cluster ID: 9c6fac7ce9f942cbb96b2a82c593d000
I20260806 10:46:25.700264 15266 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:25.721433 15266 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:25.723407 15266 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:25.744503 15266 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a285b05bc574515b32cf0e91fa784d2: Generated new TSK 0
I20260806 10:46:25.745754 15266 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:25.764505 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 15153
W20260806 10:46:25.765770 15234 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.138:36389
W20260806 10:46:25.766670 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 15153: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:46:25.766820 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 15153
W20260806 10:46:25.788429 15127 connection.cc:535] client connection to 127.0.0.1:44611 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44611): Connection reset by peer (error 104)
2026-08-06T10:46:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2152 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:25 dist-test-slave-fgb3 krb5kdc[15282](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:25 dist-test-slave-fgb3 krb5kdc[15282](info): set up 2 sockets
Aug 06 10:46:25 dist-test-slave-fgb3 krb5kdc[15282](info): commencing operation
krb5kdc: starting...
W20260806 10:46:26.979974 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:27 dist-test-slave-fgb3 krb5kdc[15282](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 10:46:27.301656 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33177
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33177
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:27.643940 15303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:27.644229 15303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:27.644345 15303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:27.651530 15303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:27.651648 15303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:27.651702 15303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:27.651795 15303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:27.651847 15303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:27.661715 15303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33177
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:27.663048 15303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:27.664323 15303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:27.675973 15309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:27.676102 15310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:27.676121 15313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:27.676923 15303 server_base.cc:1034] running on GCE node
I20260806 10:46:27.677773 15303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:27.679219 15303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:27.680428 15303 hybrid_clock.cc:648] HybridClock initialized: now 1786013187680378 us; error 39 us; skew 500 ppm
I20260806 10:46:27.680771 15303 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:27 dist-test-slave-fgb3 krb5kdc[15282](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013187, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:27.684026 15303 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 10:46:27.685515 15303 webserver.cc:460] Webserver started at http://127.0.0.1:34151/ using document root <none> and password file <none>
I20260806 10:46:27.686173 15303 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:27.686296 15303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:27.686638 15303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:27.689616 15303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "4fc0f4b314cf43e2adfc209bed046112"
format_stamp: "Formatted at 2026-08-06 10:46:27 on dist-test-slave-fgb3"
server_key: "e73ddc277a9966cd00d01564fff0bdbd"
server_key_iv: "4d84087df41ff2b6b00ddfdbf6c5cdb9"
server_key_version: "encryptionkey@0"
I20260806 10:46:27.690421 15303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "4fc0f4b314cf43e2adfc209bed046112"
format_stamp: "Formatted at 2026-08-06 10:46:27 on dist-test-slave-fgb3"
server_key: "e73ddc277a9966cd00d01564fff0bdbd"
server_key_iv: "4d84087df41ff2b6b00ddfdbf6c5cdb9"
server_key_version: "encryptionkey@0"
I20260806 10:46:27.695815 15303 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260806 10:46:27.699522 15323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:27.700912 15303 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 10:46:27.701083 15303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "4fc0f4b314cf43e2adfc209bed046112"
format_stamp: "Formatted at 2026-08-06 10:46:27 on dist-test-slave-fgb3"
server_key: "e73ddc277a9966cd00d01564fff0bdbd"
server_key_iv: "4d84087df41ff2b6b00ddfdbf6c5cdb9"
server_key_version: "encryptionkey@0"
I20260806 10:46:27.701272 15303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:27.706982 15303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:27.710718 15303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:27.710991 15303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:27.728303 15303 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33177
I20260806 10:46:27.728395 15393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33177 every 8 connection(s)
I20260806 10:46:27.729624 15303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:27.733206 15394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:27.736169 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 15303
I20260806 10:46:27.736364 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:27.736825 16565 external_mini_cluster.cc:1428] Setting key cd17f60d50b34ce72afa3f4ed5da9797
I20260806 10:46:27.745532 15397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:27.738761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:52001 (local address 127.0.0.1:33177)
0806 10:46:27.739525 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:27.739540 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:27.739588 (+ 48us) server_negotiation.cc:407] Connection header received
0806 10:46:27.741605 (+ 2017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:27.741634 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:27.742068 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:27.742564 (+ 496us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:27.743684 (+ 1120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:27.743693 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:27.743709 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:27.743733 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:27.743805 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:27.743835 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:27.744053 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:27.744207 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 10:46:27.744403 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":300,"threads_started":1}
I20260806 10:46:27.746394 15394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112: Bootstrap starting.
I20260806 10:46:27.749323 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:27.749614 15394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:27.750622 15394 log.cc:824] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:27.753737 15394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112: No bootstrap required, opened a new log
I20260806 10:46:27.756078 15397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:27.753666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:41115 (local address 127.0.0.1:33177)
0806 10:46:27.753853 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:27.753858 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:27.754256 (+ 398us) server_negotiation.cc:407] Connection header received
0806 10:46:27.754428 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:27.754434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:27.754495 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:27.754609 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:27.755453 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:27.755459 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:27.755463 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:27.755486 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:27.755535 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:27.755555 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:27.755677 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:27.755730 (+ 53us) server_negotiation.cc:299] Negotiation successful
0806 10:46:27.755796 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 10:46:27.761664 15394 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc0f4b314cf43e2adfc209bed046112" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33177 } }
I20260806 10:46:27.762006 15394 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:27.762079 15394 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fc0f4b314cf43e2adfc209bed046112, State: Initialized, Role: FOLLOWER
I20260806 10:46:27.762583 15394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc0f4b314cf43e2adfc209bed046112" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33177 } }
I20260806 10:46:27.762809 15394 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:27.762936 15394 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:27.763088 15394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:27.765306 15394 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc0f4b314cf43e2adfc209bed046112" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33177 } }
I20260806 10:46:27.765765 15394 leader_election.cc:302] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fc0f4b314cf43e2adfc209bed046112; no voters:
I20260806 10:46:27.766326 15394 leader_election.cc:288] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:27.766501 15406 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:27.767118 15406 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [term 1 LEADER]: Becoming Leader. State: Replica: 4fc0f4b314cf43e2adfc209bed046112, State: Running, Role: LEADER
I20260806 10:46:27.767690 15406 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc0f4b314cf43e2adfc209bed046112" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33177 } }
I20260806 10:46:27.768492 15394 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:27.770632 15410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fc0f4b314cf43e2adfc209bed046112. Latest consensus state: current_term: 1 leader_uuid: "4fc0f4b314cf43e2adfc209bed046112" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc0f4b314cf43e2adfc209bed046112" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33177 } } }
I20260806 10:46:27.771088 15410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:27.771009 15407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fc0f4b314cf43e2adfc209bed046112" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc0f4b314cf43e2adfc209bed046112" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33177 } } }
I20260806 10:46:27.771296 15407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:27.782135 15418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:27.786428 15418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:27.794633 15418 catalog_manager.cc:1347] Generated new cluster ID: 5d32ce0907f9412ba06e1d7467f38a94
I20260806 10:46:27.794737 15418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:27.806017 15418 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:27.806596 15418 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:27.823565 15418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4fc0f4b314cf43e2adfc209bed046112: Generated new TSK 0
I20260806 10:46:27.824452 15418 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:27.833956 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 15303
W20260806 10:46:27.835850 15388 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.138:52001
W20260806 10:46:27.836565 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 15303: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:46:27.836756 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 15303
2026-08-06T10:46:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2072 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:27 dist-test-slave-fgb3 krb5kdc[15441](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:27 dist-test-slave-fgb3 krb5kdc[15441](info): set up 2 sockets
Aug 06 10:46:27 dist-test-slave-fgb3 krb5kdc[15441](info): commencing operation
krb5kdc: starting...
W20260806 10:46:29.044644 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:29 dist-test-slave-fgb3 krb5kdc[15441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 10:46:29.367357 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37987
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:29.706933 15454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:29.707211 15454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:29.707341 15454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:29.714509 15454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:29.714630 15454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:29.714856 15454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:29.714960 15454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:29.715022 15454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:29.724936 15454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37987
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:29.726189 15454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:29.727486 15454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:29.738883 15460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:29.738942 15464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:29.738921 15459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:29.740027 15454 server_base.cc:1034] running on GCE node
I20260806 10:46:29.740763 15454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:29.742142 15454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:29.743348 15454 hybrid_clock.cc:648] HybridClock initialized: now 1786013189743293 us; error 49 us; skew 500 ppm
I20260806 10:46:29.743678 15454 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:29 dist-test-slave-fgb3 krb5kdc[15441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013189, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:29.750730 15454 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 10:46:29.752192 15454 webserver.cc:460] Webserver started at http://127.0.0.1:36639/ using document root <none> and password file <none>
I20260806 10:46:29.752838 15454 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:29.752956 15454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:29.753249 15454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:29.756234 15454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "95874d37e6144bdb803be0b5c2f4bbad"
format_stamp: "Formatted at 2026-08-06 10:46:29 on dist-test-slave-fgb3"
server_key: "9560c31faa67594934c252cde14498d2"
server_key_iv: "32731613a32d2525a9f73e7109490dce"
server_key_version: "encryptionkey@0"
I20260806 10:46:29.756999 15454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "95874d37e6144bdb803be0b5c2f4bbad"
format_stamp: "Formatted at 2026-08-06 10:46:29 on dist-test-slave-fgb3"
server_key: "9560c31faa67594934c252cde14498d2"
server_key_iv: "32731613a32d2525a9f73e7109490dce"
server_key_version: "encryptionkey@0"
I20260806 10:46:29.762045 15454 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 10:46:29.765443 15472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:29.766834 15454 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260806 10:46:29.767004 15454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "95874d37e6144bdb803be0b5c2f4bbad"
format_stamp: "Formatted at 2026-08-06 10:46:29 on dist-test-slave-fgb3"
server_key: "9560c31faa67594934c252cde14498d2"
server_key_iv: "32731613a32d2525a9f73e7109490dce"
server_key_version: "encryptionkey@0"
I20260806 10:46:29.767185 15454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:29.794732 15454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:29.798856 15454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:29.799124 15454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:29.816418 15454 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37987
I20260806 10:46:29.816453 15541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37987 every 8 connection(s)
I20260806 10:46:29.817688 15454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:29.819257 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 15454
I20260806 10:46:29.819447 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:29.819887 16565 external_mini_cluster.cc:1428] Setting key bf4ae935804d73631ee878e7cb6eb2f8
I20260806 10:46:29.821681 15543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 10:46:29 dist-test-slave-fgb3 krb5kdc[15441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 10:46:29.834537 15543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad: Bootstrap starting.
I20260806 10:46:29.838441 15543 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:29.839680 15543 log.cc:824] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:29.843036 15543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad: No bootstrap required, opened a new log
I20260806 10:46:29.843737 15546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:29.821606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:50923 (local address 127.0.0.1:37987)
0806 10:46:29.822426 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:29.822440 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:29.822489 (+ 49us) server_negotiation.cc:407] Connection header received
0806 10:46:29.824551 (+ 2062us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:29.824578 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:29.825071 (+ 493us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:29.825509 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:29.826818 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:29.828770 (+ 1952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:29.829965 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:29.830971 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:29.831140 (+ 169us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:29.835310 (+ 4170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:29.835320 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:29.835337 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:29.835387 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:29.839142 (+ 3755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:29.839885 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:29.839894 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:29.839901 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:29.840110 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:29.840712 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:29.840715 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:29.840717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:29.841350 (+ 633us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:29.841632 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:29.842087 (+ 455us) server_negotiation.cc:299] Negotiation successful
0806 10:46:29.842455 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":318,"threads_started":1}
I20260806 10:46:29.847606 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:29.851171 15543 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95874d37e6144bdb803be0b5c2f4bbad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37987 } }
I20260806 10:46:29.851511 15543 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:29.851651 15543 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95874d37e6144bdb803be0b5c2f4bbad, State: Initialized, Role: FOLLOWER
I20260806 10:46:29.852335 15543 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95874d37e6144bdb803be0b5c2f4bbad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37987 } }
I20260806 10:46:29.852607 15543 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:29.852736 15543 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:29.852924 15543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:29.855675 15543 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95874d37e6144bdb803be0b5c2f4bbad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37987 } }
I20260806 10:46:29.856233 15543 leader_election.cc:302] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95874d37e6144bdb803be0b5c2f4bbad; no voters:
I20260806 10:46:29.856865 15543 leader_election.cc:288] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:29.856961 15558 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:29.858132 15558 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [term 1 LEADER]: Becoming Leader. State: Replica: 95874d37e6144bdb803be0b5c2f4bbad, State: Running, Role: LEADER
I20260806 10:46:29.858678 15558 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95874d37e6144bdb803be0b5c2f4bbad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37987 } }
I20260806 10:46:29.859206 15543 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:29.861352 15559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95874d37e6144bdb803be0b5c2f4bbad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95874d37e6144bdb803be0b5c2f4bbad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37987 } } }
I20260806 10:46:29.862130 15559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:29.861351 15561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95874d37e6144bdb803be0b5c2f4bbad. Latest consensus state: current_term: 1 leader_uuid: "95874d37e6144bdb803be0b5c2f4bbad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95874d37e6144bdb803be0b5c2f4bbad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37987 } } }
I20260806 10:46:29.863195 15561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:29.868640 15566 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:29.869534 15546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:29.851683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:57285 (local address 127.0.0.1:37987)
0806 10:46:29.851866 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:29.851872 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:29.852399 (+ 527us) server_negotiation.cc:407] Connection header received
0806 10:46:29.852572 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:29.852577 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:29.852651 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:29.852745 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:29.854560 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:29.855320 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:29.857095 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:29.857806 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:29.857923 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:29.861365 (+ 3442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:29.861372 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:29.861378 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:29.861418 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:29.866124 (+ 4706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:29.867221 (+ 1097us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:29.867227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:29.867232 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:29.867433 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:29.868039 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:29.868044 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:29.868047 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:29.868359 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:29.868662 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:29.869019 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 10:46:29.869181 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 10:46:29.874449 15566 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:29.883659 15566 catalog_manager.cc:1347] Generated new cluster ID: 4741129b02bf4924914215d1e91186e2
I20260806 10:46:29.883782 15566 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:29.919209 15566 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:29.920495 15566 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:29.928526 15566 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95874d37e6144bdb803be0b5c2f4bbad: Generated new TSK 0
I20260806 10:46:29.929347 15566 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:29.944381 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 15454
I20260806 10:46:29.948550 15537 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:30.060930 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 15454
W20260806 10:46:30.082306 15438 connection.cc:535] client connection to 127.0.0.1:37987 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37987): Connection reset by peer (error 104)
2026-08-06T10:46:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2221 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:30 dist-test-slave-fgb3 krb5kdc[15587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:30 dist-test-slave-fgb3 krb5kdc[15587](info): set up 2 sockets
Aug 06 10:46:30 dist-test-slave-fgb3 krb5kdc[15587](info): commencing operation
krb5kdc: starting...
W20260806 10:46:31.267007 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.003s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:31 dist-test-slave-fgb3 krb5kdc[15587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 10:46:31.589174 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46351
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46351
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:31.923522 15606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:31.923825 15606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:31.923974 15606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:31.931170 15606 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:31.931329 15606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:31.931409 15606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:31.931493 15606 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:31.931553 15606 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:31.941534 15606 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46351
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:31.942917 15606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:31.944239 15606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:31.956436 15618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:31.956472 15620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:31.956499 15617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:31.957873 15606 server_base.cc:1034] running on GCE node
I20260806 10:46:31.958863 15606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:31.960472 15606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:31.961737 15606 hybrid_clock.cc:648] HybridClock initialized: now 1786013191961676 us; error 47 us; skew 500 ppm
I20260806 10:46:31.962134 15606 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:31 dist-test-slave-fgb3 krb5kdc[15587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013191, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:31.970114 15606 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 10:46:31.971824 15606 webserver.cc:460] Webserver started at http://127.0.0.1:37879/ using document root <none> and password file <none>
I20260806 10:46:31.972536 15606 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:31.972656 15606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:31.972946 15606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:31.976193 15606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "3ae835aed33e42d99a21d2058127588c"
format_stamp: "Formatted at 2026-08-06 10:46:31 on dist-test-slave-fgb3"
server_key: "9612259025daecf490315b1267c4d3d9"
server_key_iv: "656bd1094fe6ea170b4b456d9fd52f74"
server_key_version: "encryptionkey@0"
I20260806 10:46:31.976984 15606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "3ae835aed33e42d99a21d2058127588c"
format_stamp: "Formatted at 2026-08-06 10:46:31 on dist-test-slave-fgb3"
server_key: "9612259025daecf490315b1267c4d3d9"
server_key_iv: "656bd1094fe6ea170b4b456d9fd52f74"
server_key_version: "encryptionkey@0"
I20260806 10:46:31.982545 15606 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.007s
I20260806 10:46:31.986186 15629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:31.987645 15606 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:46:31.987794 15606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "3ae835aed33e42d99a21d2058127588c"
format_stamp: "Formatted at 2026-08-06 10:46:31 on dist-test-slave-fgb3"
server_key: "9612259025daecf490315b1267c4d3d9"
server_key_iv: "656bd1094fe6ea170b4b456d9fd52f74"
server_key_version: "encryptionkey@0"
I20260806 10:46:31.987972 15606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:32.011757 15606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:32.016312 15606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:32.016605 15606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:32.035447 15606 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46351
I20260806 10:46:32.035465 15702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46351 every 8 connection(s)
I20260806 10:46:32.036968 15606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:32.040913 15703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:32.045238 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 15606
I20260806 10:46:32.045425 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:32.045948 16565 external_mini_cluster.cc:1428] Setting key bc380fba0ff0c6deba1b71384deef9f3
I20260806 10:46:32.052268 15703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c: Bootstrap starting.
I20260806 10:46:32.055878 15703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:32.057168 15703 log.cc:824] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:32.060361 15708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:32.047820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:56173 (local address 127.0.0.1:46351)
0806 10:46:32.048568 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:32.048578 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:32.048619 (+ 41us) server_negotiation.cc:407] Connection header received
0806 10:46:32.050733 (+ 2114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:32.050763 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:32.051161 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:32.051477 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:32.052089 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:32.053472 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:32.055354 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:32.056092 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:32.056248 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:32.057540 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:32.057547 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:32.057562 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:32.058174 (+ 612us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:32.058265 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:32.058303 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:32.058487 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:32.058851 (+ 364us) server_negotiation.cc:299] Negotiation successful
0806 10:46:32.059042 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":326,"threads_started":1}
I20260806 10:46:32.060786 15703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c: No bootstrap required, opened a new log
I20260806 10:46:32.064558 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:32.068866 15703 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ae835aed33e42d99a21d2058127588c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46351 } }
I20260806 10:46:32.069278 15703 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:32.069377 15703 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ae835aed33e42d99a21d2058127588c, State: Initialized, Role: FOLLOWER
I20260806 10:46:32.070016 15703 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ae835aed33e42d99a21d2058127588c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46351 } }
I20260806 10:46:32.070241 15703 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:32.070418 15703 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:32.070629 15703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:32.073256 15703 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ae835aed33e42d99a21d2058127588c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46351 } }
I20260806 10:46:32.073863 15703 leader_election.cc:302] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ae835aed33e42d99a21d2058127588c; no voters:
I20260806 10:46:32.074616 15703 leader_election.cc:288] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:32.074762 15717 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:32.075771 15708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:32.068699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:43887 (local address 127.0.0.1:46351)
0806 10:46:32.068879 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:32.068884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:32.069372 (+ 488us) server_negotiation.cc:407] Connection header received
0806 10:46:32.069584 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:32.069589 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:32.069673 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:32.069779 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:32.070369 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:32.071466 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:32.072793 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:32.073455 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:32.073574 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:32.074828 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:32.074835 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:32.074840 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:32.074862 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:32.074912 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:32.074936 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:32.075086 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:32.075406 (+ 320us) server_negotiation.cc:299] Negotiation successful
0806 10:46:32.075462 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 10:46:32.075954 15717 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [term 1 LEADER]: Becoming Leader. State: Replica: 3ae835aed33e42d99a21d2058127588c, State: Running, Role: LEADER
I20260806 10:46:32.076570 15717 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ae835aed33e42d99a21d2058127588c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46351 } }
I20260806 10:46:32.076960 15703 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:32.080090 15721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ae835aed33e42d99a21d2058127588c. Latest consensus state: current_term: 1 leader_uuid: "3ae835aed33e42d99a21d2058127588c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ae835aed33e42d99a21d2058127588c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46351 } } }
I20260806 10:46:32.080118 15718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ae835aed33e42d99a21d2058127588c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ae835aed33e42d99a21d2058127588c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46351 } } }
I20260806 10:46:32.080528 15718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:32.080528 15721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:32.081971 15727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:32.088054 15727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:32.097594 15727 catalog_manager.cc:1347] Generated new cluster ID: 9f7b8ec81ef64af4899632a7351cce32
I20260806 10:46:32.097731 15727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:32.125847 15727 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:32.127184 15727 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:32.135811 15727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ae835aed33e42d99a21d2058127588c: Generated new TSK 0
I20260806 10:46:32.136950 15727 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:32.154476 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 15606
W20260806 10:46:32.155607 15696 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.138:56173
W20260806 10:46:32.156422 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 15606: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:46:32.156582 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 15606
W20260806 10:46:32.177175 15583 connection.cc:535] client connection to 127.0.0.1:46351 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46351): Connection reset by peer (error 104)
2026-08-06T10:46:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2094 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:32 dist-test-slave-fgb3 krb5kdc[15748](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:32 dist-test-slave-fgb3 krb5kdc[15748](info): set up 2 sockets
Aug 06 10:46:32 dist-test-slave-fgb3 krb5kdc[15748](info): commencing operation
krb5kdc: starting...
W20260806 10:46:33.373302 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:33 dist-test-slave-fgb3 krb5kdc[15748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 10:46:33.686071 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37031
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:34.026863 15763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:34.027184 15763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:34.027309 15763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:34.034754 15763 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:34.034888 15763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:34.034950 15763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:34.035028 15763 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:34.035071 15763 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:34.045567 15763 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37031
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:34.046983 15763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:34.048308 15763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:34.060341 15773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:34.060304 15770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:34.060372 15769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:34.061084 15763 server_base.cc:1034] running on GCE node
I20260806 10:46:34.061993 15763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:34.063530 15763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:34.064750 15763 hybrid_clock.cc:648] HybridClock initialized: now 1786013194064704 us; error 44 us; skew 500 ppm
I20260806 10:46:34.065107 15763 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:34 dist-test-slave-fgb3 krb5kdc[15748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013194, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:34.068373 15763 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 10:46:34.070086 15763 webserver.cc:460] Webserver started at http://127.0.0.1:44233/ using document root <none> and password file <none>
I20260806 10:46:34.070887 15763 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:34.071017 15763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:34.071316 15763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:34.074466 15763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "32eff23f187f47a0af6c7f9386dfd980"
format_stamp: "Formatted at 2026-08-06 10:46:34 on dist-test-slave-fgb3"
server_key: "8f4189f26ae9b82405161b089b84b6bb"
server_key_iv: "9a626a8fb1f125cb92305d33255783ab"
server_key_version: "encryptionkey@0"
I20260806 10:46:34.075232 15763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "32eff23f187f47a0af6c7f9386dfd980"
format_stamp: "Formatted at 2026-08-06 10:46:34 on dist-test-slave-fgb3"
server_key: "8f4189f26ae9b82405161b089b84b6bb"
server_key_iv: "9a626a8fb1f125cb92305d33255783ab"
server_key_version: "encryptionkey@0"
I20260806 10:46:34.080602 15763 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260806 10:46:34.084455 15781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:34.085934 15763 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 10:46:34.086114 15763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "32eff23f187f47a0af6c7f9386dfd980"
format_stamp: "Formatted at 2026-08-06 10:46:34 on dist-test-slave-fgb3"
server_key: "8f4189f26ae9b82405161b089b84b6bb"
server_key_iv: "9a626a8fb1f125cb92305d33255783ab"
server_key_version: "encryptionkey@0"
I20260806 10:46:34.086377 15763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:34.092721 15763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:34.097298 15763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:34.097615 15763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:34.116140 15763 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37031
I20260806 10:46:34.116222 15850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37031 every 8 connection(s)
I20260806 10:46:34.117653 15763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:34.118443 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 15763
I20260806 10:46:34.118642 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:34.119187 16565 external_mini_cluster.cc:1428] Setting key a56ba3d840c3920e2f3c3122b1ae9c91
I20260806 10:46:34.122737 15851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:34.127491 15856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:34.121161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:36423 (local address 127.0.0.1:37031)
0806 10:46:34.122005 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:34.122017 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:34.122062 (+ 45us) server_negotiation.cc:407] Connection header received
0806 10:46:34.123875 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:34.123902 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:34.124249 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:34.124630 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:34.125745 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:34.125755 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:34.125768 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:34.125787 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:34.125875 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:34.125900 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:34.126124 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:34.126254 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 10:46:34.126495 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":364,"threads_started":1}
I20260806 10:46:34.131461 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:34.134594 15851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980: Bootstrap starting.
I20260806 10:46:34.138413 15851 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:34.138761 15856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:34.135968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.138:36169 (local address 127.0.0.1:37031)
0806 10:46:34.136121 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:34.136125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:34.136692 (+ 567us) server_negotiation.cc:407] Connection header received
0806 10:46:34.136859 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:34.136868 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:34.136932 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:34.137016 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:34.138030 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:34.138035 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:34.138038 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:34.138055 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:34.138099 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:34.138115 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:34.138217 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:34.138385 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 10:46:34.138458 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 10:46:34.139804 15851 log.cc:824] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:34.142989 15851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980: No bootstrap required, opened a new log
I20260806 10:46:34.150449 15851 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eff23f187f47a0af6c7f9386dfd980" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37031 } }
I20260806 10:46:34.150862 15851 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:34.150943 15851 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32eff23f187f47a0af6c7f9386dfd980, State: Initialized, Role: FOLLOWER
I20260806 10:46:34.151485 15851 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eff23f187f47a0af6c7f9386dfd980" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37031 } }
I20260806 10:46:34.151698 15851 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:34.151808 15851 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:34.151934 15851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:34.154115 15851 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eff23f187f47a0af6c7f9386dfd980" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37031 } }
I20260806 10:46:34.154650 15851 leader_election.cc:302] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32eff23f187f47a0af6c7f9386dfd980; no voters:
I20260806 10:46:34.155246 15851 leader_election.cc:288] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:34.155467 15868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:34.156199 15868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [term 1 LEADER]: Becoming Leader. State: Replica: 32eff23f187f47a0af6c7f9386dfd980, State: Running, Role: LEADER
I20260806 10:46:34.156935 15868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eff23f187f47a0af6c7f9386dfd980" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37031 } }
I20260806 10:46:34.157498 15851 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:34.160168 15872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32eff23f187f47a0af6c7f9386dfd980" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eff23f187f47a0af6c7f9386dfd980" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37031 } } }
I20260806 10:46:34.160013 15874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32eff23f187f47a0af6c7f9386dfd980. Latest consensus state: current_term: 1 leader_uuid: "32eff23f187f47a0af6c7f9386dfd980" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32eff23f187f47a0af6c7f9386dfd980" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37031 } } }
I20260806 10:46:34.160636 15872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:34.160636 15874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:34.163228 15881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:34.169420 15881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:34.178303 15881 catalog_manager.cc:1347] Generated new cluster ID: d0ed4099ac074260a21d6701b3d5d7a5
I20260806 10:46:34.178491 15881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:34.195464 15881 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:34.195945 15881 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:34.203429 15881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32eff23f187f47a0af6c7f9386dfd980: Generated new TSK 0
I20260806 10:46:34.204324 15881 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:34.221184 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 15763
W20260806 10:46:34.223232 15845 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.138:36423
W20260806 10:46:34.224085 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 15763: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:46:34.224236 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 15763
2026-08-06T10:46:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2071 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:34 dist-test-slave-fgb3 krb5kdc[15899](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:34 dist-test-slave-fgb3 krb5kdc[15899](info): set up 2 sockets
Aug 06 10:46:34 dist-test-slave-fgb3 krb5kdc[15899](info): commencing operation
krb5kdc: starting...
W20260806 10:46:35.450069 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.000s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:35 dist-test-slave-fgb3 krb5kdc[15899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:46:35.763908 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:39867
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:46263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:39867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:36.102510 15915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:36.102802 15915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:36.102931 15915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:36.110121 15915 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:36.110242 15915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:36.110293 15915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:36.110409 15915 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:36.110469 15915 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:36.120472 15915 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:46263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:39867
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:39867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:36.121797 15915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:36.123209 15915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:36.134920 15924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:36.134882 15926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:36.134954 15928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:36.135648 15915 server_base.cc:1034] running on GCE node
I20260806 10:46:36.136389 15915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:36.137760 15915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:36.138972 15915 hybrid_clock.cc:648] HybridClock initialized: now 1786013196138934 us; error 30 us; skew 500 ppm
I20260806 10:46:36.139282 15915 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:36 dist-test-slave-fgb3 krb5kdc[15899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013196, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:36.142246 15915 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:46:36.143787 15915 webserver.cc:460] Webserver started at http://127.16.45.126:41567/ using document root <none> and password file <none>
I20260806 10:46:36.144459 15915 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:36.144572 15915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:36.144866 15915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:36.147851 15915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "18d65df5e0614088b671dbc2830e950c"
format_stamp: "Formatted at 2026-08-06 10:46:36 on dist-test-slave-fgb3"
server_key: "aa464057ca6eeb57d9e2771eb93fd71a"
server_key_iv: "580c3b3cb78bec96cef3f31934055da3"
server_key_version: "encryptionkey@0"
I20260806 10:46:36.148581 15915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "18d65df5e0614088b671dbc2830e950c"
format_stamp: "Formatted at 2026-08-06 10:46:36 on dist-test-slave-fgb3"
server_key: "aa464057ca6eeb57d9e2771eb93fd71a"
server_key_iv: "580c3b3cb78bec96cef3f31934055da3"
server_key_version: "encryptionkey@0"
I20260806 10:46:36.153602 15915 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 10:46:36.157071 15936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:36.158393 15915 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 10:46:36.158562 15915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "18d65df5e0614088b671dbc2830e950c"
format_stamp: "Formatted at 2026-08-06 10:46:36 on dist-test-slave-fgb3"
server_key: "aa464057ca6eeb57d9e2771eb93fd71a"
server_key_iv: "580c3b3cb78bec96cef3f31934055da3"
server_key_version: "encryptionkey@0"
I20260806 10:46:36.158736 15915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:36.196955 15915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:36.201231 15915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:36.201505 15915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:36.221585 15915 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:39867
I20260806 10:46:36.221669 16004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:39867 every 8 connection(s)
I20260806 10:46:36.223033 15915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:36.225433 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 15915
I20260806 10:46:36.225593 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:36.226032 16565 external_mini_cluster.cc:1428] Setting key 806c6a7de044c17df3c85d349315fd30
I20260806 10:46:36.227131 16005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:36.239879 16005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c: Bootstrap starting.
Aug 06 10:46:36 dist-test-slave-fgb3 krb5kdc[15899](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:46:36.243481 16005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:36.244625 16005 log.cc:824] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:36.247982 16005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c: No bootstrap required, opened a new log
I20260806 10:46:36.249171 16008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:36.227800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46335 (local address 127.16.45.126:39867)
0806 10:46:36.228619 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:36.228635 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:36.228969 (+ 334us) server_negotiation.cc:407] Connection header received
0806 10:46:36.230763 (+ 1794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:36.230786 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:36.231198 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:36.231575 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:36.233319 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:36.234744 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:36.236040 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:36.236750 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:36.236932 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:36.241385 (+ 4453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:36.241396 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:36.241411 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:36.241472 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:36.244737 (+ 3265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:36.245706 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:36.245715 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:36.245723 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:36.245950 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:36.246570 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:36.246573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:36.246575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:36.247115 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:36.247343 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:36.247877 (+ 534us) server_negotiation.cc:299] Negotiation successful
0806 10:46:36.248195 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":351,"threads_started":1}
I20260806 10:46:36.252969 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:36.255971 16005 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18d65df5e0614088b671dbc2830e950c" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39867 } }
I20260806 10:46:36.256309 16005 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:36.256404 16005 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18d65df5e0614088b671dbc2830e950c, State: Initialized, Role: FOLLOWER
I20260806 10:46:36.256980 16005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18d65df5e0614088b671dbc2830e950c" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39867 } }
I20260806 10:46:36.257301 16005 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:36.257432 16005 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:36.257601 16005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:36.259840 16005 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18d65df5e0614088b671dbc2830e950c" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39867 } }
I20260806 10:46:36.260335 16005 leader_election.cc:302] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18d65df5e0614088b671dbc2830e950c; no voters:
I20260806 10:46:36.260984 16005 leader_election.cc:288] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:36.261098 16015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:36.262210 16015 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [term 1 LEADER]: Becoming Leader. State: Replica: 18d65df5e0614088b671dbc2830e950c, State: Running, Role: LEADER
I20260806 10:46:36.263031 16015 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18d65df5e0614088b671dbc2830e950c" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39867 } }
I20260806 10:46:36.263209 16005 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:36.267670 16017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18d65df5e0614088b671dbc2830e950c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18d65df5e0614088b671dbc2830e950c" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39867 } } }
I20260806 10:46:36.268064 16017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:36.268657 16019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18d65df5e0614088b671dbc2830e950c. Latest consensus state: current_term: 1 leader_uuid: "18d65df5e0614088b671dbc2830e950c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18d65df5e0614088b671dbc2830e950c" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 39867 } } }
I20260806 10:46:36.269003 16019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:36.275017 16008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:36.257115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40679 (local address 127.16.45.126:39867)
0806 10:46:36.257322 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:36.257329 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:36.257849 (+ 520us) server_negotiation.cc:407] Connection header received
0806 10:46:36.258031 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:36.258035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:36.258094 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:36.258180 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:36.259620 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:36.260403 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:36.262102 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:36.262790 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:36.262891 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:36.266252 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:36.266260 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:36.266265 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:36.266308 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:36.270457 (+ 4149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:36.271584 (+ 1127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:36.271590 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:36.271594 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:36.271759 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:36.272344 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:36.272349 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:36.272353 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:36.272782 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:36.274134 (+ 1352us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:36.274344 (+ 210us) server_negotiation.cc:299] Negotiation successful
0806 10:46:36.274569 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:46:36.283327 16027 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:36.288467 16027 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:36.297089 16027 catalog_manager.cc:1347] Generated new cluster ID: 5b020fcf4917450085936a854512ed3c
I20260806 10:46:36.297221 16027 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:36.314620 16027 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:36.315902 16027 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:36.322018 16027 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18d65df5e0614088b671dbc2830e950c: Generated new TSK 0
I20260806 10:46:36.322826 16027 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:36.338372 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 15915
I20260806 10:46:36.339475 15999 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:36.431459 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 15915
W20260806 10:46:36.454994 15897 connection.cc:535] client connection to 127.16.45.126:39867 recv error: Network error: failed to read from TLS socket (remote: 127.16.45.126:39867): Connection reset by peer (error 104)
2026-08-06T10:46:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2206 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:36 dist-test-slave-fgb3 krb5kdc[16055](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:36 dist-test-slave-fgb3 krb5kdc[16055](info): set up 2 sockets
Aug 06 10:46:36 dist-test-slave-fgb3 krb5kdc[16055](info): commencing operation
krb5kdc: starting...
W20260806 10:46:37.650764 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:37 dist-test-slave-fgb3 krb5kdc[16055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:46:37.961675 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40685
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:34771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:40685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:38.298800 16075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:38.299119 16075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:38.299264 16075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:38.306578 16075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:38.306720 16075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:38.306797 16075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:38.306890 16075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:38.306949 16075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:38.317108 16075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:34771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:40685
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:40685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:38.318603 16075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:38.319914 16075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:38.331303 16082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:38.331264 16083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:38.331336 16088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:38.332031 16075 server_base.cc:1034] running on GCE node
I20260806 10:46:38.332747 16075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:38.334048 16075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:38.335237 16075 hybrid_clock.cc:648] HybridClock initialized: now 1786013198335193 us; error 35 us; skew 500 ppm
I20260806 10:46:38.335573 16075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:38 dist-test-slave-fgb3 krb5kdc[16055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013198, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:38.342490 16075 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:46:38.343942 16075 webserver.cc:460] Webserver started at http://127.16.45.126:39735/ using document root <none> and password file <none>
I20260806 10:46:38.344612 16075 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:38.344730 16075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:38.345023 16075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:38.348057 16075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "286562c85a724152beaef31bd4db002a"
format_stamp: "Formatted at 2026-08-06 10:46:38 on dist-test-slave-fgb3"
server_key: "9993b211c306f33816d9dd828b0633dc"
server_key_iv: "69a4fccda3b21c49376a4d841c9bf14c"
server_key_version: "encryptionkey@0"
I20260806 10:46:38.348843 16075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "286562c85a724152beaef31bd4db002a"
format_stamp: "Formatted at 2026-08-06 10:46:38 on dist-test-slave-fgb3"
server_key: "9993b211c306f33816d9dd828b0633dc"
server_key_iv: "69a4fccda3b21c49376a4d841c9bf14c"
server_key_version: "encryptionkey@0"
I20260806 10:46:38.354422 16075 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 10:46:38.357823 16096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:38.359162 16075 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 10:46:38.359323 16075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "286562c85a724152beaef31bd4db002a"
format_stamp: "Formatted at 2026-08-06 10:46:38 on dist-test-slave-fgb3"
server_key: "9993b211c306f33816d9dd828b0633dc"
server_key_iv: "69a4fccda3b21c49376a4d841c9bf14c"
server_key_version: "encryptionkey@0"
I20260806 10:46:38.359503 16075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:38.375695 16075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:38.379766 16075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:38.380034 16075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:38.397521 16075 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:40685
I20260806 10:46:38.397584 16165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:40685 every 8 connection(s)
I20260806 10:46:38.398901 16075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:38.401855 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 16075
I20260806 10:46:38.402052 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:38.402637 16565 external_mini_cluster.cc:1428] Setting key b3b9983be92cd9123cf3f7a8a12c19f6
I20260806 10:46:38.403323 16169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:38.415645 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:38.404385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54623 (local address 127.16.45.126:40685)
0806 10:46:38.405140 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:38.405151 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:38.405190 (+ 39us) server_negotiation.cc:407] Connection header received
0806 10:46:38.406782 (+ 1592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:38.406804 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:38.407182 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:38.407507 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:38.408097 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:38.409447 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:38.411323 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:38.411976 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:38.412097 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:38.413390 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:38.413400 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:38.413413 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:38.413948 (+ 535us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:38.414026 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:38.414050 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:38.414181 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:38.414480 (+ 299us) server_negotiation.cc:299] Negotiation successful
0806 10:46:38.414678 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":352,"threads_started":1}
I20260806 10:46:38.416762 16169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a: Bootstrap starting.
I20260806 10:46:38.419271 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:38.420326 16169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:38.421334 16169 log.cc:824] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:38.424512 16169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a: No bootstrap required, opened a new log
I20260806 10:46:38.430186 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:38.423544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35765 (local address 127.16.45.126:40685)
0806 10:46:38.423729 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:38.423734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:38.424108 (+ 374us) server_negotiation.cc:407] Connection header received
0806 10:46:38.424307 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:38.424310 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:38.424367 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:38.424450 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:38.425101 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:38.425874 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:38.427731 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:38.428200 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:38.428299 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:38.429475 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:38.429479 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:38.429482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:38.429499 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:38.429538 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:38.429555 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:38.429642 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:38.429817 (+ 175us) server_negotiation.cc:299] Negotiation successful
0806 10:46:38.429862 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 10:46:38.433640 16169 raft_consensus.cc:348] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "286562c85a724152beaef31bd4db002a" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40685 } }
I20260806 10:46:38.434019 16169 raft_consensus.cc:374] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:38.434095 16169 raft_consensus.cc:729] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286562c85a724152beaef31bd4db002a, State: Initialized, Role: FOLLOWER
I20260806 10:46:38.434645 16169 consensus_queue.cc:260] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "286562c85a724152beaef31bd4db002a" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40685 } }
I20260806 10:46:38.434863 16169 raft_consensus.cc:388] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:38.434968 16169 raft_consensus.cc:482] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:38.435107 16169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:38.437564 16169 raft_consensus.cc:504] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "286562c85a724152beaef31bd4db002a" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40685 } }
I20260806 10:46:38.438179 16169 leader_election.cc:302] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 286562c85a724152beaef31bd4db002a; no voters:
I20260806 10:46:38.438856 16169 leader_election.cc:288] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:38.438974 16186 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:38.439633 16186 raft_consensus.cc:686] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [term 1 LEADER]: Becoming Leader. State: Replica: 286562c85a724152beaef31bd4db002a, State: Running, Role: LEADER
I20260806 10:46:38.440155 16186 consensus_queue.cc:237] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "286562c85a724152beaef31bd4db002a" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40685 } }
I20260806 10:46:38.441004 16169 sys_catalog.cc:564] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:38.442907 16188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 286562c85a724152beaef31bd4db002a. Latest consensus state: current_term: 1 leader_uuid: "286562c85a724152beaef31bd4db002a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "286562c85a724152beaef31bd4db002a" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40685 } } }
I20260806 10:46:38.443401 16188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:38.444944 16197 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:38.444839 16187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "286562c85a724152beaef31bd4db002a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "286562c85a724152beaef31bd4db002a" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 40685 } } }
I20260806 10:46:38.445178 16187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:38.450744 16197 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:38.460191 16197 catalog_manager.cc:1347] Generated new cluster ID: e3132b6494174f01aae9eb027dd55328
I20260806 10:46:38.460359 16197 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:38.473922 16197 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:38.475332 16197 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:38.481880 16197 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 286562c85a724152beaef31bd4db002a: Generated new TSK 0
I20260806 10:46:38.482959 16197 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:38.499265 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16075
W20260806 10:46:38.500485 16158 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54623
W20260806 10:46:38.501237 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16075: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:46:38.501410 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 16075
W20260806 10:46:38.524552 16053 connection.cc:535] client connection to 127.16.45.126:40685 recv error: Network error: failed to read from TLS socket (remote: 127.16.45.126:40685): Connection reset by peer (error 104)
2026-08-06T10:46:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2069 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:38 dist-test-slave-fgb3 krb5kdc[16222](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:38 dist-test-slave-fgb3 krb5kdc[16222](info): set up 2 sockets
Aug 06 10:46:38 dist-test-slave-fgb3 krb5kdc[16222](info): commencing operation
krb5kdc: starting...
W20260806 10:46:39.713239 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.003s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:39 dist-test-slave-fgb3 krb5kdc[16222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:46:40.031332 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:46661
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:40097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:46661
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:40.374616 16241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:40.374953 16241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:40.375100 16241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:40.382985 16241 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:40.383117 16241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:40.383203 16241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:40.383285 16241 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:40.383340 16241 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:40.393587 16241 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:40097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:46661
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:46661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:40.394990 16241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:40.396314 16241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:40.407801 16247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:40.407866 16246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:40.407794 16250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:40.408644 16241 server_base.cc:1034] running on GCE node
I20260806 10:46:40.409401 16241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:40.410866 16241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:40.412072 16241 hybrid_clock.cc:648] HybridClock initialized: now 1786013200412030 us; error 34 us; skew 500 ppm
I20260806 10:46:40.412417 16241 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:40 dist-test-slave-fgb3 krb5kdc[16222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013200, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:40.415604 16241 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:46:40.417130 16241 webserver.cc:460] Webserver started at http://127.16.45.126:43271/ using document root <none> and password file <none>
I20260806 10:46:40.417779 16241 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:40.417888 16241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:40.418164 16241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:40.421226 16241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "2fe91a0a70c541bf9838d0dd696b5064"
format_stamp: "Formatted at 2026-08-06 10:46:40 on dist-test-slave-fgb3"
server_key: "f43395aabb8f96673caa66829acf8e0a"
server_key_iv: "1144788df146dca730e354ca9da56ab1"
server_key_version: "encryptionkey@0"
I20260806 10:46:40.422070 16241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "2fe91a0a70c541bf9838d0dd696b5064"
format_stamp: "Formatted at 2026-08-06 10:46:40 on dist-test-slave-fgb3"
server_key: "f43395aabb8f96673caa66829acf8e0a"
server_key_iv: "1144788df146dca730e354ca9da56ab1"
server_key_version: "encryptionkey@0"
I20260806 10:46:40.427407 16241 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 10:46:40.430959 16258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:40.432318 16241 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:46:40.432483 16241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "2fe91a0a70c541bf9838d0dd696b5064"
format_stamp: "Formatted at 2026-08-06 10:46:40 on dist-test-slave-fgb3"
server_key: "f43395aabb8f96673caa66829acf8e0a"
server_key_iv: "1144788df146dca730e354ca9da56ab1"
server_key_version: "encryptionkey@0"
I20260806 10:46:40.432670 16241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:40.438479 16241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:40.442623 16241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:40.442899 16241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:40.460116 16241 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:46661
I20260806 10:46:40.460161 16334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:46661 every 8 connection(s)
I20260806 10:46:40.461437 16241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:40.462801 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 16241
I20260806 10:46:40.462987 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:40.463536 16565 external_mini_cluster.cc:1428] Setting key de19bf8091a5bc4d16804ca8b0e5a420
I20260806 10:46:40.465786 16335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:40.471081 16338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:40.465200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48805 (local address 127.16.45.126:46661)
0806 10:46:40.465972 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:40.465983 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:40.466025 (+ 42us) server_negotiation.cc:407] Connection header received
0806 10:46:40.467619 (+ 1594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:40.467640 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:40.468089 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:40.468473 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:40.469521 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:40.469527 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:40.469539 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:40.469561 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:40.469633 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:40.469655 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:40.469824 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:40.469933 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 10:46:40.470097 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":311,"threads_started":1}
I20260806 10:46:40.474587 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:40.476889 16335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064: Bootstrap starting.
I20260806 10:46:40.480201 16335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:40.481216 16338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:40.478883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34051 (local address 127.16.45.126:46661)
0806 10:46:40.479059 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:40.479066 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:40.479438 (+ 372us) server_negotiation.cc:407] Connection header received
0806 10:46:40.479589 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:40.479594 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:40.479644 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:40.479722 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:40.480614 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:40.480620 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:40.480624 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:40.480642 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:40.480680 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:40.480694 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:40.480795 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:40.480900 (+ 105us) server_negotiation.cc:299] Negotiation successful
0806 10:46:40.480964 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:46:40.481278 16335 log.cc:824] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:40.484128 16335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064: No bootstrap required, opened a new log
I20260806 10:46:40.491463 16335 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fe91a0a70c541bf9838d0dd696b5064" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46661 } }
I20260806 10:46:40.491812 16335 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:40.491899 16335 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fe91a0a70c541bf9838d0dd696b5064, State: Initialized, Role: FOLLOWER
I20260806 10:46:40.492451 16335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fe91a0a70c541bf9838d0dd696b5064" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46661 } }
I20260806 10:46:40.492668 16335 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:40.492794 16335 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:40.492949 16335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:40.495299 16335 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fe91a0a70c541bf9838d0dd696b5064" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46661 } }
I20260806 10:46:40.495755 16335 leader_election.cc:302] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fe91a0a70c541bf9838d0dd696b5064; no voters:
I20260806 10:46:40.496322 16335 leader_election.cc:288] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:40.496438 16349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:40.497043 16349 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [term 1 LEADER]: Becoming Leader. State: Replica: 2fe91a0a70c541bf9838d0dd696b5064, State: Running, Role: LEADER
I20260806 10:46:40.497547 16349 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fe91a0a70c541bf9838d0dd696b5064" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46661 } }
I20260806 10:46:40.498307 16335 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:40.500433 16350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fe91a0a70c541bf9838d0dd696b5064" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fe91a0a70c541bf9838d0dd696b5064" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46661 } } }
I20260806 10:46:40.500830 16350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:40.503402 16361 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:40.503378 16351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fe91a0a70c541bf9838d0dd696b5064. Latest consensus state: current_term: 1 leader_uuid: "2fe91a0a70c541bf9838d0dd696b5064" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fe91a0a70c541bf9838d0dd696b5064" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46661 } } }
I20260806 10:46:40.503707 16351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:40.507678 16361 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:40.515800 16361 catalog_manager.cc:1347] Generated new cluster ID: 0a8f0d3b4cb94c748f8897b30efb5789
I20260806 10:46:40.515916 16361 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:40.531291 16361 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:40.531816 16361 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:40.548254 16361 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fe91a0a70c541bf9838d0dd696b5064: Generated new TSK 0
I20260806 10:46:40.549391 16361 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:40.556218 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16241
W20260806 10:46:40.557442 16328 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48805
W20260806 10:46:40.558210 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16241: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:46:40.558370 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 16241
2026-08-06T10:46:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2059 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:40 dist-test-slave-fgb3 krb5kdc[16379](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:40 dist-test-slave-fgb3 krb5kdc[16379](info): set up 2 sockets
Aug 06 10:46:40 dist-test-slave-fgb3 krb5kdc[16379](info): commencing operation
krb5kdc: starting...
W20260806 10:46:41.782545 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.008s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:41 dist-test-slave-fgb3 krb5kdc[16379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:46:42.098080 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:46327
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:46327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:42.434226 16400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:42.434574 16400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:42.434713 16400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:42.442121 16400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:42.442236 16400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:42.442293 16400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:42.442405 16400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:42.442471 16400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:42.452448 16400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:46327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:46327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:42.453811 16400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:42.455124 16400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:42.466872 16408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:42.466910 16413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:42.466840 16409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:42.467733 16400 server_base.cc:1034] running on GCE node
I20260806 10:46:42.468477 16400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:42.469915 16400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:42.471109 16400 hybrid_clock.cc:648] HybridClock initialized: now 1786013202471057 us; error 51 us; skew 500 ppm
I20260806 10:46:42.471458 16400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:42 dist-test-slave-fgb3 krb5kdc[16379](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013202, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:42.474596 16400 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:46:42.476047 16400 webserver.cc:460] Webserver started at http://127.16.45.126:44407/ using document root <none> and password file <none>
I20260806 10:46:42.476720 16400 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:42.476850 16400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:42.477146 16400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:42.480286 16400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "fbdc19ddf90b42b9abaf98a7dc050ed3"
format_stamp: "Formatted at 2026-08-06 10:46:42 on dist-test-slave-fgb3"
server_key: "bfc598e0a1c15330ed6fef95959e5c0c"
server_key_iv: "786520de46e089b763c311d80489a0c8"
server_key_version: "encryptionkey@0"
I20260806 10:46:42.481056 16400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "fbdc19ddf90b42b9abaf98a7dc050ed3"
format_stamp: "Formatted at 2026-08-06 10:46:42 on dist-test-slave-fgb3"
server_key: "bfc598e0a1c15330ed6fef95959e5c0c"
server_key_iv: "786520de46e089b763c311d80489a0c8"
server_key_version: "encryptionkey@0"
I20260806 10:46:42.486259 16400 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 10:46:42.489646 16423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:42.490936 16400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:46:42.491104 16400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "fbdc19ddf90b42b9abaf98a7dc050ed3"
format_stamp: "Formatted at 2026-08-06 10:46:42 on dist-test-slave-fgb3"
server_key: "bfc598e0a1c15330ed6fef95959e5c0c"
server_key_iv: "786520de46e089b763c311d80489a0c8"
server_key_version: "encryptionkey@0"
I20260806 10:46:42.491291 16400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:42.512255 16400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:42.516129 16400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:42.516405 16400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:42.533921 16400 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:46327
I20260806 10:46:42.533944 16494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:46327 every 8 connection(s)
I20260806 10:46:42.535297 16400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:42.538568 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 16400
I20260806 10:46:42.538725 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:42.539007 16496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:42.539163 16565 external_mini_cluster.cc:1428] Setting key 95efb2ca8beb791ac745c5bfbfb47626
I20260806 10:46:42.553043 16496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3: Bootstrap starting.
Aug 06 10:46:42 dist-test-slave-fgb3 krb5kdc[16379](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:46:42.556226 16496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:42.557317 16496 log.cc:824] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:42.560194 16496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3: No bootstrap required, opened a new log
I20260806 10:46:42.561792 16500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:42.540838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40735 (local address 127.16.45.126:46327)
0806 10:46:42.541597 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:42.541607 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:42.541651 (+ 44us) server_negotiation.cc:407] Connection header received
0806 10:46:42.543496 (+ 1845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:42.543517 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:42.543903 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:42.544221 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:42.545949 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:42.547253 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:42.548994 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:42.549709 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:42.549855 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:42.554556 (+ 4701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:42.554565 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:42.554578 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:42.554615 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:42.557679 (+ 3064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:42.558428 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:42.558435 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:42.558445 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:42.558614 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:42.558997 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:42.559001 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:42.559003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:42.559635 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:42.559945 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:42.560375 (+ 430us) server_negotiation.cc:299] Negotiation successful
0806 10:46:42.560819 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":330,"threads_started":1}
I20260806 10:46:42.565810 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:42.568596 16496 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbdc19ddf90b42b9abaf98a7dc050ed3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46327 } }
I20260806 10:46:42.568964 16496 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:42.569072 16496 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbdc19ddf90b42b9abaf98a7dc050ed3, State: Initialized, Role: FOLLOWER
I20260806 10:46:42.569638 16496 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbdc19ddf90b42b9abaf98a7dc050ed3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46327 } }
I20260806 10:46:42.569868 16496 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:42.570009 16496 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:42.570225 16496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:42.573519 16496 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbdc19ddf90b42b9abaf98a7dc050ed3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46327 } }
I20260806 10:46:42.574064 16496 leader_election.cc:302] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbdc19ddf90b42b9abaf98a7dc050ed3; no voters:
I20260806 10:46:42.574749 16496 leader_election.cc:288] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:42.574834 16517 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:42.576036 16517 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [term 1 LEADER]: Becoming Leader. State: Replica: fbdc19ddf90b42b9abaf98a7dc050ed3, State: Running, Role: LEADER
I20260806 10:46:42.576663 16517 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbdc19ddf90b42b9abaf98a7dc050ed3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46327 } }
I20260806 10:46:42.577039 16496 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:42.587203 16500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:42.570230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40875 (local address 127.16.45.126:46327)
0806 10:46:42.570465 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:42.570472 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:42.570858 (+ 386us) server_negotiation.cc:407] Connection header received
0806 10:46:42.571048 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:42.571051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:42.571123 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:42.571206 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:42.573056 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:42.573813 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:42.575630 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:42.576390 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:42.576536 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:42.579721 (+ 3185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:42.579729 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:42.579735 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:42.579778 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:42.583713 (+ 3935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:42.584581 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:42.584587 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:42.584591 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:42.584747 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:42.585201 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:42.585206 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:42.585209 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:42.585648 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:42.585916 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:42.586597 (+ 681us) server_negotiation.cc:299] Negotiation successful
0806 10:46:42.586827 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:46:42.587584 16519 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbdc19ddf90b42b9abaf98a7dc050ed3. Latest consensus state: current_term: 1 leader_uuid: "fbdc19ddf90b42b9abaf98a7dc050ed3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbdc19ddf90b42b9abaf98a7dc050ed3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46327 } } }
I20260806 10:46:42.587971 16519 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:42.588519 16518 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbdc19ddf90b42b9abaf98a7dc050ed3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbdc19ddf90b42b9abaf98a7dc050ed3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 46327 } } }
I20260806 10:46:42.588786 16518 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:42.588917 16541 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:42.595423 16541 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:42.604168 16541 catalog_manager.cc:1347] Generated new cluster ID: 0ca629910de840e48fadeb5e1d6f5962
I20260806 10:46:42.604280 16541 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:42.622552 16541 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:42.624423 16541 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:42.638339 16541 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbdc19ddf90b42b9abaf98a7dc050ed3: Generated new TSK 0
I20260806 10:46:42.639190 16541 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:42.655270 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16400
I20260806 10:46:42.656513 16490 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:42.748348 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 16400
2026-08-06T10:46:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2186 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:42 dist-test-slave-fgb3 krb5kdc[16559](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:42 dist-test-slave-fgb3 krb5kdc[16559](info): set up 2 sockets
Aug 06 10:46:42 dist-test-slave-fgb3 krb5kdc[16559](info): commencing operation
krb5kdc: starting...
W20260806 10:46:43.951807 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.007s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:44 dist-test-slave-fgb3 krb5kdc[16559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013204, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:46:44.266049 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:43607
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:45837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:43607
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:44.600623 16582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:44.600908 16582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:44.601012 16582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:44.608180 16582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:44.608294 16582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:44.608358 16582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:44.608417 16582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:44.608460 16582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:44.618018 16582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:45837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:43607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:43607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:44.619259 16582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:44.620491 16582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:44.631980 16589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:44.632020 16592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:44.631955 16590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:44.632800 16582 server_base.cc:1034] running on GCE node
I20260806 10:46:44.633610 16582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:44.635039 16582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:44.636292 16582 hybrid_clock.cc:648] HybridClock initialized: now 1786013204636210 us; error 35 us; skew 500 ppm
I20260806 10:46:44.636638 16582 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:44 dist-test-slave-fgb3 krb5kdc[16559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013204, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:44.642540 16582 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:46:44.643927 16582 webserver.cc:460] Webserver started at http://127.16.45.126:34565/ using document root <none> and password file <none>
I20260806 10:46:44.644768 16582 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:44.644909 16582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:44.645200 16582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:44.648175 16582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "f162eae9ea92425e8ab28ded030cea86"
format_stamp: "Formatted at 2026-08-06 10:46:44 on dist-test-slave-fgb3"
server_key: "1650569880ede2462cd49b9dd4ba7e63"
server_key_iv: "dfc345e925daf70a252a6378914365da"
server_key_version: "encryptionkey@0"
I20260806 10:46:44.648911 16582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "f162eae9ea92425e8ab28ded030cea86"
format_stamp: "Formatted at 2026-08-06 10:46:44 on dist-test-slave-fgb3"
server_key: "1650569880ede2462cd49b9dd4ba7e63"
server_key_iv: "dfc345e925daf70a252a6378914365da"
server_key_version: "encryptionkey@0"
I20260806 10:46:44.653857 16582 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 10:46:44.657127 16601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:44.658447 16582 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:46:44.658612 16582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "f162eae9ea92425e8ab28ded030cea86"
format_stamp: "Formatted at 2026-08-06 10:46:44 on dist-test-slave-fgb3"
server_key: "1650569880ede2462cd49b9dd4ba7e63"
server_key_iv: "dfc345e925daf70a252a6378914365da"
server_key_version: "encryptionkey@0"
I20260806 10:46:44.658787 16582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:44.688983 16582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:44.693727 16582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:44.694015 16582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:44.711885 16582 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:43607
I20260806 10:46:44.711934 16677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:43607 every 8 connection(s)
I20260806 10:46:44.713263 16582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:44.716897 16678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:44.717845 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 16582
I20260806 10:46:44.718030 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:44.718519 16565 external_mini_cluster.cc:1428] Setting key 3c7a7cb2aac7c86c06feb1b7fe905449
I20260806 10:46:44.730257 16678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86: Bootstrap starting.
I20260806 10:46:44.731943 16681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:44.720394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41973 (local address 127.16.45.126:43607)
0806 10:46:44.721193 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:44.721204 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:44.721252 (+ 48us) server_negotiation.cc:407] Connection header received
0806 10:46:44.722881 (+ 1629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:44.722908 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:44.723308 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:44.723636 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:44.724216 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:44.725550 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:44.727416 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:44.728112 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:44.728268 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:44.729502 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:44.729509 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:44.729523 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:44.730173 (+ 650us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:44.730270 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:44.730299 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:44.730451 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:44.730634 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 10:46:44.730920 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":349,"threads_started":1}
I20260806 10:46:44.733562 16678 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:44.734736 16678 log.cc:824] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:44.735634 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:44.737546 16678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86: No bootstrap required, opened a new log
I20260806 10:46:44.746254 16681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:44.739808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35087 (local address 127.16.45.126:43607)
0806 10:46:44.739992 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:44.739998 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:44.740484 (+ 486us) server_negotiation.cc:407] Connection header received
0806 10:46:44.740642 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:44.740647 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:44.740732 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:44.740849 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:44.741353 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:44.742493 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:44.743793 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:44.744526 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:44.744651 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:44.745604 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:44.745610 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:44.745615 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:44.745639 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:44.745684 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:44.745707 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:44.745803 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:44.745875 (+ 72us) server_negotiation.cc:299] Negotiation successful
0806 10:46:44.745963 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 10:46:44.746766 16678 raft_consensus.cc:348] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f162eae9ea92425e8ab28ded030cea86" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 43607 } }
I20260806 10:46:44.747131 16678 raft_consensus.cc:374] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:44.747229 16678 raft_consensus.cc:729] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f162eae9ea92425e8ab28ded030cea86, State: Initialized, Role: FOLLOWER
I20260806 10:46:44.747853 16678 consensus_queue.cc:260] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f162eae9ea92425e8ab28ded030cea86" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 43607 } }
I20260806 10:46:44.748078 16678 raft_consensus.cc:388] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:44.748214 16678 raft_consensus.cc:482] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:44.748394 16678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:44.750666 16678 raft_consensus.cc:504] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f162eae9ea92425e8ab28ded030cea86" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 43607 } }
I20260806 10:46:44.751142 16678 leader_election.cc:302] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f162eae9ea92425e8ab28ded030cea86; no voters:
I20260806 10:46:44.751770 16678 leader_election.cc:288] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:44.751915 16691 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:44.752584 16691 raft_consensus.cc:686] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [term 1 LEADER]: Becoming Leader. State: Replica: f162eae9ea92425e8ab28ded030cea86, State: Running, Role: LEADER
I20260806 10:46:44.753068 16691 consensus_queue.cc:237] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f162eae9ea92425e8ab28ded030cea86" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 43607 } }
I20260806 10:46:44.753813 16678 sys_catalog.cc:564] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:44.756219 16692 sys_catalog.cc:455] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f162eae9ea92425e8ab28ded030cea86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f162eae9ea92425e8ab28ded030cea86" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 43607 } } }
I20260806 10:46:44.756981 16692 sys_catalog.cc:458] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:44.756227 16693 sys_catalog.cc:455] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f162eae9ea92425e8ab28ded030cea86. Latest consensus state: current_term: 1 leader_uuid: "f162eae9ea92425e8ab28ded030cea86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f162eae9ea92425e8ab28ded030cea86" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 43607 } } }
I20260806 10:46:44.757372 16693 sys_catalog.cc:458] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:44.759359 16706 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:44.764405 16706 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:44.780848 16706 catalog_manager.cc:1347] Generated new cluster ID: 36c6edd3d84b4a9fa067720d883609b4
I20260806 10:46:44.780982 16706 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:44.795035 16706 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:44.796904 16706 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:44.806218 16706 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f162eae9ea92425e8ab28ded030cea86: Generated new TSK 0
I20260806 10:46:44.807307 16706 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:44.821177 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16582
W20260806 10:46:44.822170 16668 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41973
W20260806 10:46:44.822870 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16582: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:46:44.823004 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 16582
2026-08-06T10:46:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2076 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:44 dist-test-slave-fgb3 krb5kdc[16727](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:44 dist-test-slave-fgb3 krb5kdc[16727](info): set up 2 sockets
Aug 06 10:46:44 dist-test-slave-fgb3 krb5kdc[16727](info): commencing operation
krb5kdc: starting...
W20260806 10:46:46.041756 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.003s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:46 dist-test-slave-fgb3 krb5kdc[16727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:46:46.365765 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:44079
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:43311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:44079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:46.709189 16742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:46.709478 16742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:46.709578 16742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:46.716897 16742 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:46.717010 16742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:46.717060 16742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:46.717120 16742 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:46.717159 16742 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:46.727099 16742 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:43311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:44079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:44079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:46.728399 16742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:46.729652 16742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:46.741305 16749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:46.741377 16750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:46.741351 16752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:46.742238 16742 server_base.cc:1034] running on GCE node
I20260806 10:46:46.743124 16742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:46.744642 16742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:46.745847 16742 hybrid_clock.cc:648] HybridClock initialized: now 1786013206745788 us; error 64 us; skew 500 ppm
I20260806 10:46:46.746182 16742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:46 dist-test-slave-fgb3 krb5kdc[16727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013206, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:46.749333 16742 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:46:46.750913 16742 webserver.cc:460] Webserver started at http://127.16.45.126:46819/ using document root <none> and password file <none>
I20260806 10:46:46.751576 16742 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:46.751680 16742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:46.751937 16742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:46.755012 16742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "69f3e5b6d20942d78e4a4c54d7247086"
format_stamp: "Formatted at 2026-08-06 10:46:46 on dist-test-slave-fgb3"
server_key: "f679ab35c2ad1b49925c0992adc1cbe5"
server_key_iv: "4a4d52280e132777c6f0b269578c779d"
server_key_version: "encryptionkey@0"
I20260806 10:46:46.755740 16742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "69f3e5b6d20942d78e4a4c54d7247086"
format_stamp: "Formatted at 2026-08-06 10:46:46 on dist-test-slave-fgb3"
server_key: "f679ab35c2ad1b49925c0992adc1cbe5"
server_key_iv: "4a4d52280e132777c6f0b269578c779d"
server_key_version: "encryptionkey@0"
I20260806 10:46:46.761045 16742 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260806 10:46:46.764767 16763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:46.766427 16742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:46:46.766619 16742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "69f3e5b6d20942d78e4a4c54d7247086"
format_stamp: "Formatted at 2026-08-06 10:46:46 on dist-test-slave-fgb3"
server_key: "f679ab35c2ad1b49925c0992adc1cbe5"
server_key_iv: "4a4d52280e132777c6f0b269578c779d"
server_key_version: "encryptionkey@0"
I20260806 10:46:46.766832 16742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:46.772851 16742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:46.777657 16742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:46.778020 16742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:46.798094 16742 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:44079
I20260806 10:46:46.798094 16837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:44079 every 8 connection(s)
I20260806 10:46:46.799679 16742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:46.803570 16838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:46.807756 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 16742
I20260806 10:46:46.807946 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:46.808482 16565 external_mini_cluster.cc:1428] Setting key dc53811fe8873163b87623b887ebe1cf
I20260806 10:46:46.816187 16844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:46.810397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55815 (local address 127.16.45.126:44079)
0806 10:46:46.811201 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:46.811213 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:46.811257 (+ 44us) server_negotiation.cc:407] Connection header received
0806 10:46:46.812869 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:46.812893 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:46.813246 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:46.813572 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:46.814695 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:46.814702 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:46.814715 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:46.814730 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:46.814804 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:46.814824 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:46.814994 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:46.815093 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 10:46:46.815262 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":368,"threads_started":1}
I20260806 10:46:46.816843 16838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086: Bootstrap starting.
I20260806 10:46:46.819698 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:46.820034 16838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:46.821228 16838 log.cc:824] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:46.824481 16838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086: No bootstrap required, opened a new log
I20260806 10:46:46.827013 16844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:46.824518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56613 (local address 127.16.45.126:44079)
0806 10:46:46.824693 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:46.824699 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:46.825136 (+ 437us) server_negotiation.cc:407] Connection header received
0806 10:46:46.825282 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:46.825286 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:46.825343 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:46.825427 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:46.826397 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:46.826401 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:46.826404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 10:46:46.826420 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:46.826459 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 10:46:46.826477 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:46.826573 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:46.826683 (+ 110us) server_negotiation.cc:299] Negotiation successful
0806 10:46:46.826733 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 10:46:46.832805 16838 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69f3e5b6d20942d78e4a4c54d7247086" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44079 } }
I20260806 10:46:46.833174 16838 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 10:46:46.833262 16838 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f3e5b6d20942d78e4a4c54d7247086, State: Initialized, Role: FOLLOWER
I20260806 10:46:46.833807 16838 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69f3e5b6d20942d78e4a4c54d7247086" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44079 } }
I20260806 10:46:46.834040 16838 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 10:46:46.834182 16838 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 10:46:46.834370 16838 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:46.836814 16838 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69f3e5b6d20942d78e4a4c54d7247086" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44079 } }
I20260806 10:46:46.837302 16838 leader_election.cc:302] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69f3e5b6d20942d78e4a4c54d7247086; no voters:
I20260806 10:46:46.837888 16838 leader_election.cc:288] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 10:46:46.838016 16855 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:46.838685 16855 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [term 1 LEADER]: Becoming Leader. State: Replica: 69f3e5b6d20942d78e4a4c54d7247086, State: Running, Role: LEADER
I20260806 10:46:46.839219 16855 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69f3e5b6d20942d78e4a4c54d7247086" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44079 } }
I20260806 10:46:46.839952 16838 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:46.841857 16856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69f3e5b6d20942d78e4a4c54d7247086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69f3e5b6d20942d78e4a4c54d7247086" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44079 } } }
I20260806 10:46:46.842298 16856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:46.842823 16857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69f3e5b6d20942d78e4a4c54d7247086. Latest consensus state: current_term: 1 leader_uuid: "69f3e5b6d20942d78e4a4c54d7247086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69f3e5b6d20942d78e4a4c54d7247086" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 44079 } } }
I20260806 10:46:46.843060 16857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:46.846781 16871 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:46.851986 16871 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:46.860438 16871 catalog_manager.cc:1347] Generated new cluster ID: caff651f2ad7480d8ca96784295ed233
I20260806 10:46:46.860558 16871 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:46.876314 16871 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:46.876827 16871 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:46.883797 16871 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69f3e5b6d20942d78e4a4c54d7247086: Generated new TSK 0
I20260806 10:46:46.884687 16871 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:46.896595 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16742
W20260806 10:46:46.897891 16832 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55815
W20260806 10:46:46.898694 16565 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16742: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 10:46:46.898839 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 16742
2026-08-06T10:46:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2074 ms)
[----------] 18 tests from AuthTokenIssuingTest (38100 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:47 dist-test-slave-fgb3 krb5kdc[16888](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:47 dist-test-slave-fgb3 krb5kdc[16888](info): set up 2 sockets
Aug 06 10:46:47 dist-test-slave-fgb3 krb5kdc[16888](info): commencing operation
krb5kdc: starting...
W20260806 10:46:48.121026 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.001s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:48 dist-test-slave-fgb3 krb5kdc[16888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:46:48.449829 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:41355
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:41355,127.16.45.125:43905,127.16.45.124:35129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:48.795414 16906 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 10:46:48.795794 16906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:48.795902 16906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:48.796021 16906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:48.803669 16906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:48.803791 16906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:48.803876 16906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:48.803942 16906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:48.804031 16906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:48.814265 16906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:41355,127.16.45.125:43905,127.16.45.124:35129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:41355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:48.815655 16906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:48.817003 16906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:48.829349 16914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:48.829368 16918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:48.829504 16912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:48.831001 16906 server_base.cc:1034] running on GCE node
I20260806 10:46:48.831902 16906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:48.833559 16906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:48.834829 16906 hybrid_clock.cc:648] HybridClock initialized: now 1786013208834746 us; error 34 us; skew 500 ppm
I20260806 10:46:48.835178 16906 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:48 dist-test-slave-fgb3 krb5kdc[16888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013208, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:48.838619 16906 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:46:48.840310 16906 webserver.cc:460] Webserver started at http://127.16.45.126:39459/ using document root <none> and password file <none>
I20260806 10:46:48.841022 16906 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:48.841126 16906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:48.841439 16906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:48.844586 16906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "0bc7e3b68ec945578d1da9c282e40ca3"
format_stamp: "Formatted at 2026-08-06 10:46:48 on dist-test-slave-fgb3"
server_key: "012a9aee2aaa65df5c608d7c159c8bc1"
server_key_iv: "7fefe73be1333899067080052ed0f85d"
server_key_version: "encryptionkey@0"
I20260806 10:46:48.845395 16906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "0bc7e3b68ec945578d1da9c282e40ca3"
format_stamp: "Formatted at 2026-08-06 10:46:48 on dist-test-slave-fgb3"
server_key: "012a9aee2aaa65df5c608d7c159c8bc1"
server_key_iv: "7fefe73be1333899067080052ed0f85d"
server_key_version: "encryptionkey@0"
I20260806 10:46:48.850667 16906 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 10:46:48.854413 16932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:48.855799 16906 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:46:48.855978 16906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "0bc7e3b68ec945578d1da9c282e40ca3"
format_stamp: "Formatted at 2026-08-06 10:46:48 on dist-test-slave-fgb3"
server_key: "012a9aee2aaa65df5c608d7c159c8bc1"
server_key_iv: "7fefe73be1333899067080052ed0f85d"
server_key_version: "encryptionkey@0"
I20260806 10:46:48.856197 16906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:48.869189 16906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:48.873603 16906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:48.873885 16906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:48.891857 16906 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:41355
I20260806 10:46:48.891865 17008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:41355 every 8 connection(s)
I20260806 10:46:48.893273 16906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:48.897120 17010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:48.903110 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 16906
I20260806 10:46:48.903345 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:48.904193 16565 external_mini_cluster.cc:1428] Setting key 2b00b0c400804ff5764aa7563fb6a1eb
I20260806 10:46:48.904017 17010 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:46:48 dist-test-slave-fgb3 krb5kdc[16888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013208, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:46:48.927281 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:48.907728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:41355 (local address 127.0.0.1:54932)
0806 10:46:48.908567 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:48.908613 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:48.910643 (+ 2030us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:48.911464 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:48.911471 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:48.912193 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:48.912534 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:48.912552 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:48.914100 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:48.914103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:48.915214 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:48.915226 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:48.916138 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:48.916145 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:48.916303 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:48.916944 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:48.916967 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:48.919210 (+ 2243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:48.923013 (+ 3803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:48.923024 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:48.923034 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:48.923462 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:48.923867 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:48.923872 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:48.923875 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:48.924035 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:48.924809 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:48.924817 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:48.925044 (+ 227us) client_negotiation.cc:769] Sending connection context
0806 10:46:48.925260 (+ 216us) client_negotiation.cc:240] Negotiation successful
0806 10:46:48.925935 (+ 675us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":145,"thread_start_us":341,"threads_started":1}
I20260806 10:46:48.927312 17013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:48.907729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54932 (local address 127.16.45.126:41355)
0806 10:46:48.909342 (+ 1613us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:48.909350 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:48.909407 (+ 57us) server_negotiation.cc:407] Connection header received
0806 10:46:48.910996 (+ 1589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:48.911001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:48.911230 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:48.911406 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:48.912738 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:48.913949 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:48.915346 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:48.915902 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:48.916066 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:48.919452 (+ 3386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:48.919463 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:48.919478 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:48.919512 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:48.922868 (+ 3356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:48.923601 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:48.923607 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:48.923610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:48.923760 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:48.924142 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:48.924145 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:48.924147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:48.924679 (+ 532us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:48.924881 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:48.925424 (+ 543us) server_negotiation.cc:299] Negotiation successful
0806 10:46:48.925795 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":1405,"thread_start_us":1190,"threads_started":1}
I20260806 10:46:48.930495 17010 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } has no permanent_uuid. Determining permanent_uuid...
I20260806 10:46:48.931711 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:48.931311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45184)
0806 10:46:48.931486 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:48.931594 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260806 10:46:48.931983 16936 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
I20260806 10:46:48.933539 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:48.933176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45200)
0806 10:46:48.933320 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:48.933398 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 10:46:48.933756 17010 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:43905: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.16.45.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.125.keytab.
Entry for principal kudu/127.16.45.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.125.keytab.
I20260806 10:46:48.975354 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.125:43905
--webserver_interface=127.16.45.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.125.keytab
--principal=kudu/127.16.45.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:41355,127.16.45.125:43905,127.16.45.124:35129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:46:48.983108 17010 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } attempt: 1
I20260806 10:46:48.984338 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:48.983871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45214)
0806 10:46:48.984061 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:48.984200 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 10:46:48.985324 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:48.984969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45228)
0806 10:46:48.985097 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:48.985166 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 10:46:48.985520 17010 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:43905: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
I20260806 10:46:49.053789 17010 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } attempt: 2
I20260806 10:46:49.055083 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.054603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45236)
0806 10:46:49.054812 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.054927 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260806 10:46:49.056195 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.055762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45242)
0806 10:46:49.055942 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.056045 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260806 10:46:49.056504 17010 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:43905: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
I20260806 10:46:49.147821 17010 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } attempt: 3
I20260806 10:46:49.149187 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.148650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45246)
0806 10:46:49.148943 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.149045 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
I20260806 10:46:49.150405 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.149946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45250)
0806 10:46:49.150104 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.150174 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260806 10:46:49.150621 17010 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:43905: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
I20260806 10:46:49.293941 17010 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } attempt: 4
I20260806 10:46:49.295146 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.294603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45256)
0806 10:46:49.294919 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.295009 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
I20260806 10:46:49.296337 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.295905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45266)
0806 10:46:49.296107 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.296197 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260806 10:46:49.296576 17010 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:43905: Network error: Client connection negotiation failed: client connection to 127.16.45.125:43905: connect: Connection refused (error 111)
W20260806 10:46:49.330281 17017 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 10:46:49.330680 17017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:49.330755 17017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:49.330847 17017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:49.338238 17017 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:49.338378 17017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:49.338450 17017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:49.338505 17017 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:49.338567 17017 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:49.348906 17017 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:41355,127.16.45.125:43905,127.16.45.124:35129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.125.keytab
--principal=kudu/127.16.45.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.125:43905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.16.45.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:49.350270 17017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:49.351679 17017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:49.366703 17025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:49.366653 17032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:49.367004 17026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:49.368144 17017 server_base.cc:1034] running on GCE node
I20260806 10:46:49.369030 17017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:49.370642 17017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:49.371893 17017 hybrid_clock.cc:648] HybridClock initialized: now 1786013209371822 us; error 43 us; skew 500 ppm
I20260806 10:46:49.372290 17017 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:49 dist-test-slave-fgb3 krb5kdc[16888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013209, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:49.375811 17017 init.cc:377] Logged in from keytab as kudu/127.16.45.125@KRBTEST.COM (short username kudu)
I20260806 10:46:49.377576 17017 webserver.cc:460] Webserver started at http://127.16.45.125:35611/ using document root <none> and password file <none>
I20260806 10:46:49.378352 17017 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:49.378468 17017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:49.378813 17017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:49.381929 17017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/data/instance:
uuid: "e1849480c62348c2994e3a085a0e9e59"
format_stamp: "Formatted at 2026-08-06 10:46:49 on dist-test-slave-fgb3"
server_key: "001ef9da65203374b25a048bdce3988c"
server_key_iv: "4472fb064dee7969bba105fabe86a73f"
server_key_version: "encryptionkey@0"
I20260806 10:46:49.382803 17017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/wal/instance:
uuid: "e1849480c62348c2994e3a085a0e9e59"
format_stamp: "Formatted at 2026-08-06 10:46:49 on dist-test-slave-fgb3"
server_key: "001ef9da65203374b25a048bdce3988c"
server_key_iv: "4472fb064dee7969bba105fabe86a73f"
server_key_version: "encryptionkey@0"
I20260806 10:46:49.388378 17017 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260806 10:46:49.391979 17045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:49.393424 17017 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 10:46:49.393606 17017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/wal
uuid: "e1849480c62348c2994e3a085a0e9e59"
format_stamp: "Formatted at 2026-08-06 10:46:49 on dist-test-slave-fgb3"
server_key: "001ef9da65203374b25a048bdce3988c"
server_key_iv: "4472fb064dee7969bba105fabe86a73f"
server_key_version: "encryptionkey@0"
I20260806 10:46:49.393829 17017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:49.414287 17017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:49.418571 17017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:49.418848 17017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:49.437770 17017 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.125:43905
I20260806 10:46:49.437777 17120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.125:43905 every 8 connection(s)
I20260806 10:46:49.439234 17017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
I20260806 10:46:49.443109 17121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:49.449268 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 17017
I20260806 10:46:49.449486 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-1/wal/instance
I20260806 10:46:49.450030 16565 external_mini_cluster.cc:1428] Setting key 2a34d3f04f0a195e98702ea1f6c9b2a6
I20260806 10:46:49.449972 17121 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:46:49 dist-test-slave-fgb3 krb5kdc[16888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013209, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.125@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:46:49.473106 17124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.453208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54936 (local address 127.16.45.126:41355)
0806 10:46:49.453774 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:49.453781 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:49.454766 (+ 985us) server_negotiation.cc:407] Connection header received
0806 10:46:49.457058 (+ 2292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:49.457063 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:49.457142 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:49.457240 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:49.459289 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.460139 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.462167 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.462625 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.462722 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:49.466453 (+ 3731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:49.466460 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:49.466464 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:49.466509 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:49.469755 (+ 3246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:49.470599 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:49.470605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:49.470609 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:49.470795 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:49.471222 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:49.471226 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:49.471229 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:49.471563 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:49.471717 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:49.472513 (+ 796us) server_negotiation.cc:299] Negotiation successful
0806 10:46:49.472728 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":273,"threads_started":1}
I20260806 10:46:49.473995 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.453772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:41355 (local address 127.0.0.1:54936)
0806 10:46:49.454586 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.454633 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:49.456760 (+ 2127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:49.457502 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:49.457513 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:49.458221 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:49.459028 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:49.459051 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.460313 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.460318 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:49.462017 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:49.462031 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.462854 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.462861 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:49.463147 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:49.463847 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:49.463874 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:49.466209 (+ 2335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:49.469916 (+ 3707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:49.469924 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:49.469938 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:49.470464 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:49.470917 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:49.470921 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:49.470923 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:49.471113 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:49.471705 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:49.471712 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:49.472076 (+ 364us) client_negotiation.cc:769] Sending connection context
0806 10:46:49.472351 (+ 275us) client_negotiation.cc:240] Negotiation successful
0806 10:46:49.472770 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":297,"threads_started":1}
I20260806 10:46:49.475888 17121 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.16.45.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.124@KRBTEST.COM" created.
Aug 06 10:46:49 dist-test-slave-fgb3 krb5kdc[16888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013209, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.125@KRBTEST.COM for kudu/127.16.45.125@KRBTEST.COM
I20260806 10:46:49.493112 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.476705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45278)
0806 10:46:49.476872 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.476890 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:49.477018 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:49.477901 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:49.477905 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:49.478292 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:49.478475 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:49.478485 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.480352 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.480356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:49.481197 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:49.481208 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.482386 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.482391 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:49.482523 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:49.483048 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:49.483064 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:49.487702 (+ 4638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:49.490755 (+ 3053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:49.490760 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:49.490765 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:49.491109 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:49.491446 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:49.491451 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:49.491455 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:49.491590 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:49.492148 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:49.492153 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:49.492288 (+ 135us) client_negotiation.cc:769] Sending connection context
0806 10:46:49.492430 (+ 142us) client_negotiation.cc:240] Negotiation successful
0806 10:46:49.492699 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260806 10:46:49.493212 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.476730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45278 (local address 127.16.45.125:43905)
0806 10:46:49.477380 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:49.477388 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:49.477428 (+ 40us) server_negotiation.cc:407] Connection header received
0806 10:46:49.477483 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:49.477491 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:49.477717 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:49.477866 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:49.478651 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.480223 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.481339 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.482190 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.482339 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:49.487937 (+ 5598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:49.487949 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:49.487963 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:49.487994 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:49.490642 (+ 2648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:49.491228 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:49.491235 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:49.491237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:49.491350 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:49.491684 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:49.491689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:49.491692 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:49.492029 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:49.492224 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:49.492593 (+ 369us) server_negotiation.cc:299] Negotiation successful
0806 10:46:49.492804 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":284,"threads_started":1}
I20260806 10:46:49.495847 17121 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } has no permanent_uuid. Determining permanent_uuid...
I20260806 10:46:49.496842 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.496415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:47986)
0806 10:46:49.496586 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.496696 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 10:46:49.497100 17050 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
I20260806 10:46:49.498755 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.498439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:47994)
0806 10:46:49.498573 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.498655 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260806 10:46:49.498960 17121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:35129: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.124.keytab.
Entry for principal kudu/127.16.45.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.124.keytab.
I20260806 10:46:49.525094 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.124:35129
--webserver_interface=127.16.45.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.124.keytab
--principal=kudu/127.16.45.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:41355,127.16.45.125:43905,127.16.45.124:35129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:46:49.548303 17121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } attempt: 1
I20260806 10:46:49.549563 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.549089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48010)
0806 10:46:49.549291 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.549406 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 10:46:49.550611 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.550231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48016)
0806 10:46:49.550422 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.550498 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 10:46:49.550817 17121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:35129: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
I20260806 10:46:49.595856 17010 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } attempt: 5
Aug 06 10:46:49 dist-test-slave-fgb3 krb5kdc[16888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013208, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for kudu/127.16.45.125@KRBTEST.COM
I20260806 10:46:49.610253 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.596797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45292 (local address 127.16.45.125:43905)
0806 10:46:49.596975 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:49.596979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:49.596998 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:46:49.597320 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:49.597324 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:49.597419 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:49.597517 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:49.598598 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.599315 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.600956 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.601402 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.601494 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:49.605100 (+ 3606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:49.605105 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:49.605108 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:49.605141 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:49.607671 (+ 2530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:49.608468 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:49.608472 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:49.608475 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:49.608599 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:49.608980 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:49.608983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:49.608984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:49.609252 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:49.609367 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:49.609796 (+ 429us) server_negotiation.cc:299] Negotiation successful
0806 10:46:49.610002 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 10:46:49.610404 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.596653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45292)
0806 10:46:49.596887 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.596912 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:49.597049 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:49.597587 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:49.597592 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:49.598157 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:49.598442 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:49.598456 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.599472 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.599477 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:49.600793 (+ 1316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:49.600810 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.601558 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.601564 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:49.601777 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:49.602429 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:49.602453 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:49.604912 (+ 2459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:49.607805 (+ 2893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:49.607811 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:49.607815 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:49.608330 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:49.608706 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:49.608711 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:49.608714 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:49.608892 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:49.609364 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:49.609369 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:49.609546 (+ 177us) client_negotiation.cc:769] Sending connection context
0806 10:46:49.609730 (+ 184us) client_negotiation.cc:240] Negotiation successful
0806 10:46:49.610026 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 10:46:49.611555 17010 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } has no permanent_uuid. Determining permanent_uuid...
I20260806 10:46:49.612700 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.612224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48030)
0806 10:46:49.612412 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.612515 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 10:46:49.613674 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.613313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48036)
0806 10:46:49.613467 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.613559 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260806 10:46:49.613864 17010 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:35129: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
I20260806 10:46:49.619025 17121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } attempt: 2
I20260806 10:46:49.620015 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.619603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48048)
0806 10:46:49.619776 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.619868 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 10:46:49.621018 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.620703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48064)
0806 10:46:49.620823 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.620904 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 10:46:49.621222 17121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:35129: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
I20260806 10:46:49.665131 17010 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } attempt: 1
I20260806 10:46:49.666508 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.665889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48072)
0806 10:46:49.666117 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.666233 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260806 10:46:49.667634 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.667263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48074)
0806 10:46:49.667413 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.667502 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 10:46:49.667898 17010 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:35129: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
I20260806 10:46:49.712457 17121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } attempt: 3
I20260806 10:46:49.713794 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.713212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48076)
0806 10:46:49.713494 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.713606 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260806 10:46:49.715037 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.714565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48078)
0806 10:46:49.714823 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.714912 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
W20260806 10:46:49.715292 17121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:35129: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
I20260806 10:46:49.736131 17010 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } attempt: 2
I20260806 10:46:49.737411 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.736853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48088)
0806 10:46:49.737091 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.737204 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 10:46:49.738454 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.738055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48100)
0806 10:46:49.738209 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.738296 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 10:46:49.738654 17010 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:35129: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
I20260806 10:46:49.844888 17010 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } attempt: 3
I20260806 10:46:49.846215 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.845623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48106)
0806 10:46:49.845853 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.845979 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 10:46:49.847332 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.846920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48116)
0806 10:46:49.847090 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.847190 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 10:46:49.847560 17010 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:35129: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
I20260806 10:46:49.858520 17121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } attempt: 4
I20260806 10:46:49.859807 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.859246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48130)
0806 10:46:49.859484 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.859580 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 10:46:49.860916 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.860500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48138)
0806 10:46:49.860674 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.860787 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260806 10:46:49.861112 17121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:35129: Network error: Client connection negotiation failed: client connection to 127.16.45.124:35129: connect: Connection refused (error 111)
W20260806 10:46:49.872116 17134 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 10:46:49.872476 17134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:49.872576 17134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:49.872682 17134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:49.880208 17134 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:49.880326 17134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:49.880393 17134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:49.880470 17134 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:49.880554 17134 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:49.890978 17134 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:41355,127.16.45.125:43905,127.16.45.124:35129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.124.keytab
--principal=kudu/127.16.45.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.124:35129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.16.45.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:49.892819 17134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:49.894418 17134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:49.907791 17141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:49.907614 17140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:49.908516 17144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:49.908846 17134 server_base.cc:1034] running on GCE node
I20260806 10:46:49.909605 17134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:49.911087 17134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:49.912340 17134 hybrid_clock.cc:648] HybridClock initialized: now 1786013209912265 us; error 39 us; skew 500 ppm
I20260806 10:46:49.912710 17134 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:49 dist-test-slave-fgb3 krb5kdc[16888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013209, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:49.920403 17134 init.cc:377] Logged in from keytab as kudu/127.16.45.124@KRBTEST.COM (short username kudu)
I20260806 10:46:49.921942 17134 webserver.cc:460] Webserver started at http://127.16.45.124:34757/ using document root <none> and password file <none>
I20260806 10:46:49.922691 17134 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:49.922793 17134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:49.923102 17134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:49.926065 17134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/data/instance:
uuid: "2b95f41fc208436f8b6d840c75cfb601"
format_stamp: "Formatted at 2026-08-06 10:46:49 on dist-test-slave-fgb3"
server_key: "aed93131fdbab4955cd035d2a266abe1"
server_key_iv: "5c078d32ae3140ea00fa292f842754f9"
server_key_version: "encryptionkey@0"
I20260806 10:46:49.926904 17134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/wal/instance:
uuid: "2b95f41fc208436f8b6d840c75cfb601"
format_stamp: "Formatted at 2026-08-06 10:46:49 on dist-test-slave-fgb3"
server_key: "aed93131fdbab4955cd035d2a266abe1"
server_key_iv: "5c078d32ae3140ea00fa292f842754f9"
server_key_version: "encryptionkey@0"
I20260806 10:46:49.931696 17134 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260806 10:46:49.934927 17157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:49.936147 17134 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 10:46:49.936335 17134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/wal
uuid: "2b95f41fc208436f8b6d840c75cfb601"
format_stamp: "Formatted at 2026-08-06 10:46:49 on dist-test-slave-fgb3"
server_key: "aed93131fdbab4955cd035d2a266abe1"
server_key_iv: "5c078d32ae3140ea00fa292f842754f9"
server_key_version: "encryptionkey@0"
I20260806 10:46:49.936529 17134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:49.952397 17134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:49.956421 17134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:49.956696 17134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:49.974728 17134 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.124:35129
I20260806 10:46:49.974764 17243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.124:35129 every 8 connection(s)
I20260806 10:46:49.976033 17134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
I20260806 10:46:49.977260 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 17134
I20260806 10:46:49.977465 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786012840862403-16565-0/minicluster-data/master-2/wal/instance
I20260806 10:46:49.978010 16565 external_mini_cluster.cc:1428] Setting key 84f31b1bd7909ebf76fa1ff8884c81cb
I20260806 10:46:49.980652 17246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:49.987214 17246 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:46:49 dist-test-slave-fgb3 krb5kdc[16888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.124@KRBTEST.COM
Aug 06 10:46:49 dist-test-slave-fgb3 krb5kdc[16888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013209, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.124@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:46:49.999121 17249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.979922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48150 (local address 127.16.45.124:35129)
0806 10:46:49.980663 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:49.980674 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:49.980720 (+ 46us) server_negotiation.cc:407] Connection header received
0806 10:46:49.982350 (+ 1630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:49.982384 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:49.982750 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:49.983110 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:49.984575 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.985907 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.987174 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.987858 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.988014 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:49.992202 (+ 4188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:49.992209 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:49.992218 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:49.992251 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:49.995043 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:49.995715 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:49.995721 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:49.995727 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:49.995895 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:49.996245 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:49.996249 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:49.996251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:49.996881 (+ 630us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:49.997195 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:49.997590 (+ 395us) server_negotiation.cc:299] Negotiation successful
0806 10:46:49.997962 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":347,"threads_started":1}
I20260806 10:46:50.003999 17252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.989581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54950 (local address 127.16.45.126:41355)
0806 10:46:49.990755 (+ 1174us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:49.990759 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:49.990776 (+ 17us) server_negotiation.cc:407] Connection header received
0806 10:46:49.990823 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:49.990826 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:49.990899 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:49.990996 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:49.992126 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.992786 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.994127 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.994563 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.994683 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:49.998008 (+ 3325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:49.998013 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:49.998016 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:49.998049 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:50.000992 (+ 2943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.001778 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.001783 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.001786 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.001937 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.002373 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.002385 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.002389 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.002878 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:50.003040 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.003549 (+ 509us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.003712 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1083,"thread_start_us":952,"threads_started":1}
I20260806 10:46:50.004190 17251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:49.989450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:41355 (local address 127.0.0.1:54950)
0806 10:46:49.990134 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:49.990179 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:49.990357 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:49.991077 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:49.991083 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:49.991738 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:49.991985 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:49.991994 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.992930 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.992934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:49.993985 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:49.993997 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:49.994740 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:49.994747 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:49.994905 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:49.995432 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:49.995447 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:49.997675 (+ 2228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:50.001132 (+ 3457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:50.001141 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:50.001145 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:50.001669 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:50.002045 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:50.002049 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:50.002052 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:50.002221 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:50.003016 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:50.003022 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:50.003210 (+ 188us) client_negotiation.cc:769] Sending connection context
0806 10:46:50.003458 (+ 248us) client_negotiation.cc:240] Negotiation successful
0806 10:46:50.003794 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":282,"threads_started":1}
I20260806 10:46:50.005604 17246 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:46:50 dist-test-slave-fgb3 krb5kdc[16888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
Aug 06 10:46:50 dist-test-slave-fgb3 krb5kdc[16888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013209, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.124@KRBTEST.COM for kudu/127.16.45.125@KRBTEST.COM
I20260806 10:46:50.017818 17253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.002205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54958 (local address 127.16.45.126:41355)
0806 10:46:50.002892 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.002897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.002920 (+ 23us) server_negotiation.cc:407] Connection header received
0806 10:46:50.002966 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.002970 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.003036 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.003125 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.004657 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.005597 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.007035 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.007463 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.007585 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.012274 (+ 4689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:50.012280 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:50.012283 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:50.012314 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:50.014980 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.015756 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.015760 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.015762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.015894 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.016340 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.016343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.016345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.016636 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:50.016852 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.017165 (+ 313us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.017407 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":316,"threads_started":1}
I20260806 10:46:50.019194 17251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.006336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:43905 (local address 127.0.0.1:45304)
0806 10:46:50.006508 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:50.006528 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:50.006619 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:50.006925 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:50.006929 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:50.007278 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:50.007415 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:50.007423 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.008386 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.008392 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:50.009754 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:50.009770 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.010528 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.010534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:50.010714 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.011249 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:50.011272 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:50.013501 (+ 2229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:50.016660 (+ 3159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:50.016665 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:50.016670 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:50.017178 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:50.017621 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:50.017626 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:50.017629 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:50.017814 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:50.018413 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:50.018418 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:50.018555 (+ 137us) client_negotiation.cc:769] Sending connection context
0806 10:46:50.018679 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 10:46:50.018942 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 10:46:50.019382 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.006525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45304 (local address 127.16.45.125:43905)
0806 10:46:50.006670 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.006675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.006690 (+ 15us) server_negotiation.cc:407] Connection header received
0806 10:46:50.006740 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.006743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.006800 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.006877 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.007558 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.008248 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.009908 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.010382 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.010484 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.013697 (+ 3213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:50.013704 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:50.013708 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:50.013750 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:50.016540 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.017303 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.017308 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.017312 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.017477 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.017942 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.017948 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.017952 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.018255 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:50.018460 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.018804 (+ 344us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.019026 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 10:46:50.020604 17246 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } has no permanent_uuid. Determining permanent_uuid...
I20260806 10:46:50.024778 17010 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } attempt: 4
Aug 06 10:46:50 dist-test-slave-fgb3 krb5kdc[16888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013209, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.124@KRBTEST.COM for kudu/127.16.45.124@KRBTEST.COM
Aug 06 10:46:50 dist-test-slave-fgb3 krb5kdc[16888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.125@KRBTEST.COM
I20260806 10:46:50.036149 17251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.021202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48166)
0806 10:46:50.021345 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:50.021363 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:50.021452 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:50.021757 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:50.021761 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:50.022250 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:50.022451 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:50.022463 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.023874 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.023879 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:50.024902 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:50.024916 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.025915 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.025921 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:50.026159 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.026799 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:50.026823 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:50.029676 (+ 2853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:50.033450 (+ 3774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:50.033455 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:50.033463 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:50.033954 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:50.034372 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:50.034376 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:50.034379 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:50.034539 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:50.035175 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:50.035180 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:50.035319 (+ 139us) client_negotiation.cc:769] Sending connection context
0806 10:46:50.035460 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 10:46:50.035784 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
Aug 06 10:46:50 dist-test-slave-fgb3 krb5kdc[16888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013208, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for kudu/127.16.45.124@KRBTEST.COM
I20260806 10:46:50.036912 17249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.021412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48166 (local address 127.16.45.124:35129)
0806 10:46:50.021553 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.021558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.021572 (+ 14us) server_negotiation.cc:407] Connection header received
0806 10:46:50.021607 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.021610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.021655 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.021729 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.022607 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.023727 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.025038 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.025619 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.025708 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.029849 (+ 4141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:50.029855 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:50.029864 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:50.029897 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:50.033312 (+ 3415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.034066 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.034070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.034074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.034225 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.034652 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.034657 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.034660 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.034997 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:50.035130 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.036435 (+ 1305us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.036663 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 10:46:50.038954 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.019781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45308 (local address 127.16.45.125:43905)
0806 10:46:50.020083 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.020088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.020103 (+ 15us) server_negotiation.cc:407] Connection header received
0806 10:46:50.020143 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.020148 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.020216 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.020304 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.021983 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.022979 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.024283 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.025038 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.025163 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.032314 (+ 7151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:50.032322 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:50.032327 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:50.032373 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:50.035908 (+ 3535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.036759 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.036764 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.036768 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.036940 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.037382 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.037387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.037391 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.037741 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:50.038052 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.038363 (+ 311us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.038582 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":15164,"threads_started":1}
I20260806 10:46:50.043366 17246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601: Bootstrap starting.
I20260806 10:46:50.044775 17012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.025365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48174)
0806 10:46:50.025737 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:50.025756 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:50.025871 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:50.028934 (+ 3063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:50.028939 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:50.029441 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:50.029654 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:50.029666 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.031518 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.031524 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:50.032898 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:50.032915 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.033938 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.033944 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:50.034128 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.034720 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:50.034743 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:50.037408 (+ 2665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:50.041915 (+ 4507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:50.041921 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:50.041925 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:50.042474 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:50.042880 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:50.042885 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:50.042889 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:50.043068 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:50.043760 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:50.043765 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:50.043969 (+ 204us) client_negotiation.cc:769] Sending connection context
0806 10:46:50.044105 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 10:46:50.044409 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250}
I20260806 10:46:50.045820 17255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.026202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48174 (local address 127.16.45.124:35129)
0806 10:46:50.028604 (+ 2402us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.028609 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.028632 (+ 23us) server_negotiation.cc:407] Connection header received
0806 10:46:50.028676 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.028681 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.028747 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.029798 (+ 1051us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.030047 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.031356 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.033087 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.033767 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.034444 (+ 677us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.037637 (+ 3193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:50.037644 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:50.037649 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:50.037680 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:50.041773 (+ 4093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.042600 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.042605 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.042609 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.042746 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.043217 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.043221 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.043225 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.043616 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:50.045026 (+ 1410us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.045152 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.045389 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2278,"thread_start_us":4494,"threads_started":1}
I20260806 10:46:50.046531 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:50.051872 17010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3: Bootstrap starting.
I20260806 10:46:50.049996 16971 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "0bc7e3b68ec945578d1da9c282e40ca3"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54958
I20260806 10:46:50.056404 17010 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:50.057706 17010 log.cc:824] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:50.059648 17246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:50.061033 17246 log.cc:824] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:50.063898 17010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3: No bootstrap required, opened a new log
I20260806 10:46:50.068477 17246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601: No bootstrap required, opened a new log
I20260806 10:46:50.070580 17010 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } }
I20260806 10:46:50.071036 17010 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bc7e3b68ec945578d1da9c282e40ca3, State: Initialized, Role: FOLLOWER
I20260806 10:46:50.071554 17010 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } }
I20260806 10:46:50.072861 17260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } } }
I20260806 10:46:50.073702 17260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:50.074010 17010 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:50.074221 16971 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 10:46:50.074456 16971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:50.078073 16971 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } }
I20260806 10:46:50.079620 17246 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } }
I20260806 10:46:50.080084 17246 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b95f41fc208436f8b6d840c75cfb601, State: Initialized, Role: FOLLOWER
I20260806 10:46:50.080641 17246 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } }
I20260806 10:46:50.081629 17262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } } }
I20260806 10:46:50.082074 17262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:50.081898 16971 leader_election.cc:288] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [CANDIDATE]: Term 1 election: Requested vote from peers e1849480c62348c2994e3a085a0e9e59 (127.16.45.125:43905), 2b95f41fc208436f8b6d840c75cfb601 (127.16.45.124:35129)
I20260806 10:46:50.083401 17246 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:50.084890 17207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2b95f41fc208436f8b6d840c75cfb601"
I20260806 10:46:50.085659 17207 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:50.089757 17207 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc7e3b68ec945578d1da9c282e40ca3 in term 1.
I20260806 10:46:50.090620 16936 leader_election.cc:302] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc7e3b68ec945578d1da9c282e40ca3, 2b95f41fc208436f8b6d840c75cfb601; no voters:
I20260806 10:46:50.092696 17260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:50.095194 17260 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [term 1 LEADER]: Becoming Leader. State: Replica: 0bc7e3b68ec945578d1da9c282e40ca3, State: Running, Role: LEADER
I20260806 10:46:50.098261 17260 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } }
W20260806 10:46:50.128062 16938 tablet.cc:2369] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:46:50.133508 17310 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 10:46:50.134815 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.107663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45318 (local address 127.16.45.125:43905)
0806 10:46:50.107848 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.107854 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.107879 (+ 25us) server_negotiation.cc:407] Connection header received
0806 10:46:50.108176 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.108184 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.108282 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.108358 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.114821 (+ 6463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.116057 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.120335 (+ 4278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.121091 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.121234 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.125009 (+ 3775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:50.125017 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:50.125022 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:50.125065 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:50.128693 (+ 3628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.130116 (+ 1423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.130122 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.130126 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.130348 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.131084 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.131089 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.131112 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.131696 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:50.132082 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.133080 (+ 998us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.133462 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:46:50.135355 17278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bc7e3b68ec945578d1da9c282e40ca3. Latest consensus state: current_term: 1 leader_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } } }
I20260806 10:46:50.135939 17278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:50.139516 17311 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:50.136559 17134 master_runner.cc:186] Error getting master registration for 127.16.45.126:41355: OK, instance_id { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" instance_seqno: 1786013208886736 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 10:46:50.146822 17134 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 10:46:50.147509 17255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.108393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48190 (local address 127.16.45.124:35129)
0806 10:46:50.108593 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.108600 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.113456 (+ 4856us) server_negotiation.cc:407] Connection header received
0806 10:46:50.120403 (+ 6947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.120410 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.120526 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.120601 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.122801 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.123957 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.126479 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.127210 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.127363 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.131332 (+ 3969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:50.131341 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:50.131347 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:50.131394 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:50.136553 (+ 5159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.141097 (+ 4544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.141128 (+ 31us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.141133 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.141408 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.143300 (+ 1892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.143306 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.143309 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.144091 (+ 782us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:50.144480 (+ 389us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.146820 (+ 2340us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.147215 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 10:46:50.151005 17253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.107230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54970 (local address 127.16.45.126:41355)
0806 10:46:50.107464 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.107470 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.112767 (+ 5297us) server_negotiation.cc:407] Connection header received
0806 10:46:50.114371 (+ 1604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.114378 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.114497 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.114581 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.126636 (+ 12055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.127686 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.133889 (+ 6203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.134581 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.134700 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.142660 (+ 7960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:50.142667 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:50.142672 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:50.142722 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:50.146430 (+ 3708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.147270 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.147275 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.147278 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.147488 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.147989 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.147998 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.148001 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.148369 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:50.148632 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.150359 (+ 1727us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.150619 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 10:46:50.153275 17311 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:50.160315 17121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } attempt: 5
I20260806 10:46:50.147426 16906 master_runner.cc:186] Error getting master registration for 127.16.45.125:43905: OK, instance_id { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" instance_seqno: 1786013209432464 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 10:46:50.160907 16906 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 06 10:46:50 dist-test-slave-fgb3 krb5kdc[16888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013209, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.125@KRBTEST.COM for kudu/127.16.45.124@KRBTEST.COM
I20260806 10:46:50.175129 17207 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [term 1 FOLLOWER]: Refusing update from remote peer 0bc7e3b68ec945578d1da9c282e40ca3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:46:50.176262 17278 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:46:50.180992 17125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.160973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:35129 (local address 127.0.0.1:48200)
0806 10:46:50.161534 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:50.161557 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:50.161680 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:50.163446 (+ 1766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:50.163453 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:50.164013 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:50.164239 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:50.164251 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.165752 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.165759 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:50.167293 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:50.167309 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.168309 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.168315 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:50.168560 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.169383 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:50.169407 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:50.172439 (+ 3032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:50.177772 (+ 5333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:50.177778 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:50.177782 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:50.178421 (+ 639us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:50.178917 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:50.178922 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:50.178926 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:50.179101 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:50.179837 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:50.179865 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:50.180040 (+ 175us) client_negotiation.cc:769] Sending connection context
0806 10:46:50.180187 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 10:46:50.180510 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418}
I20260806 10:46:50.181360 17255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.161901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48200 (local address 127.16.45.124:35129)
0806 10:46:50.162096 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.162102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.162122 (+ 20us) server_negotiation.cc:407] Connection header received
0806 10:46:50.162179 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.162185 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.162260 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.162403 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.164413 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.165547 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.167469 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.168125 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.168256 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.172658 (+ 4402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:50.172665 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:50.172671 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:50.172711 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:50.177619 (+ 4908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.178584 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.178589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.178593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.178769 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:50.179244 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:50.179249 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:50.179252 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:50.179642 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:50.179836 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.180429 (+ 593us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.180794 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 10:46:50.187690 17121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59: Bootstrap starting.
I20260806 10:46:50.187855 17262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bc7e3b68ec945578d1da9c282e40ca3. Latest consensus state: current_term: 1 leader_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } } }
I20260806 10:46:50.188179 17262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:50.191882 17121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:50.193209 17121 log.cc:824] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:50.195289 17260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } } }
I20260806 10:46:50.195657 17260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:50.201467 17311 catalog_manager.cc:1347] Generated new cluster ID: b980cc61e9584b77b4662ca16fe4e399
I20260806 10:46:50.201601 17311 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:50.206938 17262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } } }
I20260806 10:46:50.207219 17262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:50.208681 17121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59: No bootstrap required, opened a new log
I20260806 10:46:50.219712 17121 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } }
I20260806 10:46:50.220176 17121 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1849480c62348c2994e3a085a0e9e59, State: Initialized, Role: FOLLOWER
I20260806 10:46:50.220706 17121 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } }
I20260806 10:46:50.224182 17328 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } } }
I20260806 10:46:50.224601 17328 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:50.225883 17121 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:50.226334 17081 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:50.230103 17081 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [term 1 FOLLOWER]: Refusing update from remote peer 0bc7e3b68ec945578d1da9c282e40ca3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:46:50.225903 17083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e1849480c62348c2994e3a085a0e9e59"
I20260806 10:46:50.234231 17083 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc7e3b68ec945578d1da9c282e40ca3 in term 1.
I20260806 10:46:50.239706 17278 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:46:50.251821 17311 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:50.253895 17311 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:50.275318 17311 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3: Generated new TSK 0
I20260806 10:46:50.276641 17311 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 10:46:50.279639 17328 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bc7e3b68ec945578d1da9c282e40ca3. Latest consensus state: current_term: 1 leader_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } } }
I20260806 10:46:50.279983 17328 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:50.281440 17278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } } }
I20260806 10:46:50.281708 17278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bc7e3b68ec945578d1da9c282e40ca3 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:50.284217 17339 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bc7e3b68ec945578d1da9c282e40ca3" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41355 } } peers { permanent_uuid: "e1849480c62348c2994e3a085a0e9e59" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 43905 } } peers { permanent_uuid: "2b95f41fc208436f8b6d840c75cfb601" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 35129 } } }
I20260806 10:46:50.284698 17339 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:50.304699 17357 catalog_manager.cc:1259] Loaded cluster ID: b980cc61e9584b77b4662ca16fe4e399
I20260806 10:46:50.304895 17357 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59: loading cluster ID for follower catalog manager: success
I20260806 10:46:50.308287 17357 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59: acquiring CA information for follower catalog manager: success
I20260806 10:46:50.310143 17357 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e1849480c62348c2994e3a085a0e9e59: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 10:46:50.377048 17253 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:50.366645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54974 (local address 127.16.45.126:41355)
0806 10:46:50.366850 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.366856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.373350 (+ 6494us) server_negotiation.cc:407] Connection header received
0806 10:46:50.375040 (+ 1690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.375048 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.375152 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.375257 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.376705 (+ 1448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54974: BlockingRecv error: recv got EOF from 127.0.0.1:54974 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 10:46:50.380921 17255 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:50.374063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48206 (local address 127.16.45.124:35129)
0806 10:46:50.374270 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.374287 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.378736 (+ 4449us) server_negotiation.cc:407] Connection header received
0806 10:46:50.379395 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.379401 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.379489 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.379569 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.380657 (+ 1088us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48206: BlockingRecv error: recv got EOF from 127.0.0.1:48206 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260806 10:46:50.381189 17129 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:50.365993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45332 (local address 127.16.45.125:43905)
0806 10:46:50.366455 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.366467 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.378691 (+ 12224us) server_negotiation.cc:407] Connection header received
0806 10:46:50.379933 (+ 1242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.379939 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.380023 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.380096 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.380972 (+ 876us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45332: BlockingRecv error: recv got EOF from 127.0.0.1:45332 (error 108)
Metrics: {"server-negotiator.queue_time_us":261}
I20260806 10:46:50.403481 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.387074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45342 (local address 127.16.45.125:43905)
0806 10:46:50.387264 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.387271 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.394702 (+ 7431us) server_negotiation.cc:407] Connection header received
0806 10:46:50.394849 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.394856 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.395089 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.395335 (+ 246us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:50.396039 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.397236 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.399757 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.400574 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.400701 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.401586 (+ 885us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:50.402581 (+ 995us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:50.402735 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.403039 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.403143 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260806 10:46:50.413712 17255 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:50.411118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48218 (local address 127.16.45.124:35129)
0806 10:46:50.411322 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.411329 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.412216 (+ 887us) server_negotiation.cc:407] Connection header received
0806 10:46:50.412529 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.412533 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.412633 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.412719 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.413484 (+ 765us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48218: BlockingRecv error: recv got EOF from 127.0.0.1:48218 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 10:46:50.423542 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.417908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45358 (local address 127.16.45.125:43905)
0806 10:46:50.418133 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.418139 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.418624 (+ 485us) server_negotiation.cc:407] Connection header received
0806 10:46:50.418792 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.418798 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.418870 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.418945 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:50.419346 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.420109 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.421421 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.421973 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.422103 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.422704 (+ 601us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:50.422882 (+ 178us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:50.422950 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.423162 (+ 212us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.423241 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
W20260806 10:46:50.435391 17255 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:50.433210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48220 (local address 127.16.45.124:35129)
0806 10:46:50.433401 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.433408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.433913 (+ 505us) server_negotiation.cc:407] Connection header received
0806 10:46:50.434079 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.434085 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.434164 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.434260 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.435170 (+ 910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48220: BlockingRecv error: recv got EOF from 127.0.0.1:48220 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:46:50.480501 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.474564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45372 (local address 127.16.45.125:43905)
0806 10:46:50.474749 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.474757 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.475310 (+ 553us) server_negotiation.cc:407] Connection header received
0806 10:46:50.475510 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.475516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.475590 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.475690 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:50.476270 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.477051 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.478556 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.479065 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.479191 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.479706 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:50.479829 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:50.479913 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.480076 (+ 163us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.480166 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260806 10:46:50.488802 17255 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:50.486569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48236 (local address 127.16.45.124:35129)
0806 10:46:50.486732 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.486738 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.487504 (+ 766us) server_negotiation.cc:407] Connection header received
0806 10:46:50.487660 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.487665 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.487743 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.487827 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.488553 (+ 726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48236: BlockingRecv error: recv got EOF from 127.0.0.1:48236 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 10:46:50.501844 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.495971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45374 (local address 127.16.45.125:43905)
0806 10:46:50.496221 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.496228 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.496691 (+ 463us) server_negotiation.cc:407] Connection header received
0806 10:46:50.496875 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.496879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.496965 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.497039 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:50.497499 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.498555 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.500042 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.500563 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.500673 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.501116 (+ 443us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:50.501230 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:50.501317 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.501467 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.501546 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
W20260806 10:46:50.511493 17255 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:50.509229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48238 (local address 127.16.45.124:35129)
0806 10:46:50.509547 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.509554 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.510105 (+ 551us) server_negotiation.cc:407] Connection header received
0806 10:46:50.510282 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.510288 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.510438 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.510529 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.511280 (+ 751us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48238: BlockingRecv error: recv got EOF from 127.0.0.1:48238 (error 108)
Metrics: {"server-negotiator.queue_time_us":185}
I20260806 10:46:50.529874 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.524165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45386 (local address 127.16.45.125:43905)
0806 10:46:50.524391 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.524398 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.524935 (+ 537us) server_negotiation.cc:407] Connection header received
0806 10:46:50.525147 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.525152 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.525222 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.525303 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:50.525760 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.526697 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.528133 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.528597 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.528707 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.529093 (+ 386us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:50.529208 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:50.529286 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.529436 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.529519 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
W20260806 10:46:50.538472 17255 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:50.535974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48244 (local address 127.16.45.124:35129)
0806 10:46:50.536176 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.536183 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.536897 (+ 714us) server_negotiation.cc:407] Connection header received
0806 10:46:50.537077 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.537084 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.537177 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.537297 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.538206 (+ 909us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48244: BlockingRecv error: recv got EOF from 127.0.0.1:48244 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 10:46:50.566883 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.560647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45394 (local address 127.16.45.125:43905)
0806 10:46:50.560869 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.560877 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.561475 (+ 598us) server_negotiation.cc:407] Connection header received
0806 10:46:50.561699 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.561705 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.561785 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.561881 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:50.562472 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.563428 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.564874 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.565362 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.565488 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.565994 (+ 506us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:50.566156 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:50.566256 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.566447 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.566555 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260806 10:46:50.575789 17255 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:50.573279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48254 (local address 127.16.45.124:35129)
0806 10:46:50.573518 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.573525 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.574128 (+ 603us) server_negotiation.cc:407] Connection header received
0806 10:46:50.574348 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.574355 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.574453 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.574549 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.575530 (+ 981us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48254: BlockingRecv error: recv got EOF from 127.0.0.1:48254 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 10:46:50.616498 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.610960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45408 (local address 127.16.45.125:43905)
0806 10:46:50.611201 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.611209 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.611728 (+ 519us) server_negotiation.cc:407] Connection header received
0806 10:46:50.611967 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.611971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.612042 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.612120 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:50.612568 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.613315 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.614727 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.615212 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.615322 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.615728 (+ 406us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:50.615837 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:50.615913 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.616065 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.616156 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260806 10:46:50.624769 17255 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:50.622647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48268 (local address 127.16.45.124:35129)
0806 10:46:50.622870 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.622877 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.623399 (+ 522us) server_negotiation.cc:407] Connection header received
0806 10:46:50.623558 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.623564 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.623663 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.623751 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.624532 (+ 781us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48268: BlockingRecv error: recv got EOF from 127.0.0.1:48268 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 10:46:50.705060 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.699262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45414 (local address 127.16.45.125:43905)
0806 10:46:50.699503 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.699509 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.700072 (+ 563us) server_negotiation.cc:407] Connection header received
0806 10:46:50.700363 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.700370 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.700458 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.700543 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:50.701059 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.701849 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.703195 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.703742 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.703871 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.704315 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:50.704436 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:50.704520 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.704667 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.704752 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
W20260806 10:46:50.713979 17255 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:50.711363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48278 (local address 127.16.45.124:35129)
0806 10:46:50.711558 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.711564 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.712601 (+ 1037us) server_negotiation.cc:407] Connection header received
0806 10:46:50.712803 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.712809 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.712898 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.712993 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.713792 (+ 799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48278: BlockingRecv error: recv got EOF from 127.0.0.1:48278 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 10:46:50.851279 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:50.846186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45422 (local address 127.16.45.125:43905)
0806 10:46:50.846479 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.846485 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.846747 (+ 262us) server_negotiation.cc:407] Connection header received
0806 10:46:50.846964 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.846968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.847061 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.847139 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:50.847603 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.848292 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.849577 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:50.850024 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:50.850136 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:50.850578 (+ 442us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:50.850695 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:50.850774 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:50.850920 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 10:46:50.851005 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
W20260806 10:46:50.858983 17255 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:50.856946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48284 (local address 127.16.45.124:35129)
0806 10:46:50.857188 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:50.857194 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:50.857404 (+ 210us) server_negotiation.cc:407] Connection header received
0806 10:46:50.857590 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:50.857622 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:50.857749 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:50.857893 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:50.858730 (+ 837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48284: BlockingRecv error: recv got EOF from 127.0.0.1:48284 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
I20260806 10:46:51.124104 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:51.119171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45428 (local address 127.16.45.125:43905)
0806 10:46:51.119411 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:51.119418 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:51.119677 (+ 259us) server_negotiation.cc:407] Connection header received
0806 10:46:51.119858 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:51.119862 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:51.119934 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:51.120024 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:51.120419 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:51.121146 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:51.122549 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:51.122981 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:51.123083 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:51.123480 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:51.123596 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:51.123668 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:51.123764 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 10:46:51.123835 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
W20260806 10:46:51.131987 17255 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:51.130393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48290 (local address 127.16.45.124:35129)
0806 10:46:51.130589 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:51.130596 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:51.130732 (+ 136us) server_negotiation.cc:407] Connection header received
0806 10:46:51.130899 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:51.130903 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:51.130994 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:51.131079 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:51.131805 (+ 726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48290: BlockingRecv error: recv got EOF from 127.0.0.1:48290 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 10:46:51.138556 17310 catalog_manager.cc:1259] Loaded cluster ID: b980cc61e9584b77b4662ca16fe4e399
I20260806 10:46:51.138700 17310 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601: loading cluster ID for follower catalog manager: success
I20260806 10:46:51.142477 17310 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601: acquiring CA information for follower catalog manager: success
I20260806 10:46:51.144886 17310 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2b95f41fc208436f8b6d840c75cfb601: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 10:46:51.652870 17521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:51.647741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45438 (local address 127.16.45.125:43905)
0806 10:46:51.648230 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:51.648236 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:51.648317 (+ 81us) server_negotiation.cc:407] Connection header received
0806 10:46:51.648545 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:51.648549 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:51.648626 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:51.648713 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:51.649142 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:51.649898 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:51.651264 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:51.651672 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:51.651784 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:51.652172 (+ 388us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:51.652279 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:51.652356 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:51.652505 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 10:46:51.652589 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":240,"threads_started":1}
I20260806 10:46:51.663972 17531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:51.658228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48298 (local address 127.16.45.124:35129)
0806 10:46:51.658750 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:51.658756 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:51.658870 (+ 114us) server_negotiation.cc:407] Connection header received
0806 10:46:51.659074 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:51.659078 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:51.659228 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:51.659334 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:51.659786 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:51.660484 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:51.661786 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:51.662199 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:51.662295 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:51.662803 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:51.663367 (+ 564us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:51.663491 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:51.663615 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 10:46:51.663688 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":248,"threads_started":1}
I20260806 10:46:51.677399 17521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:51.670251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45440 (local address 127.16.45.125:43905)
0806 10:46:51.670512 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:51.670520 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:51.671379 (+ 859us) server_negotiation.cc:407] Connection header received
0806 10:46:51.671718 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:51.671724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:51.671816 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:51.671885 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:51.672569 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:51.673519 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:51.675412 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:51.676022 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:51.676157 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:51.676590 (+ 433us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:51.676726 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:51.676818 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:51.677025 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 10:46:51.677115 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260806 10:46:51.678113 17531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:51.671411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48306 (local address 127.16.45.124:35129)
0806 10:46:51.671597 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:51.671604 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:51.672013 (+ 409us) server_negotiation.cc:407] Connection header received
0806 10:46:51.672187 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:51.672193 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:51.672299 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:51.672375 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:51.673124 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:51.674132 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:51.676216 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:51.676690 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:51.676804 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:51.677361 (+ 557us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:51.677464 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:51.677540 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:51.677733 (+ 193us) server_negotiation.cc:299] Negotiation successful
0806 10:46:51.677825 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 10:46:51.678774 17538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:51.670243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54990 (local address 127.16.45.126:41355)
0806 10:46:51.670755 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:51.670761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:51.671401 (+ 640us) server_negotiation.cc:407] Connection header received
0806 10:46:51.671936 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:51.671940 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:51.672141 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:51.672345 (+ 204us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:51.672930 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:51.674017 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:51.676052 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:51.676641 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:51.676760 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:51.677281 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:51.677763 (+ 482us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:51.677867 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:51.678393 (+ 526us) server_negotiation.cc:299] Negotiation successful
0806 10:46:51.678484 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":277,"threads_started":1}
I20260806 10:46:51.683877 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 16906
I20260806 10:46:51.685273 17004 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:51.795883 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 16906
W20260806 10:46:51.819052 17165 connection.cc:535] server connection from 127.0.0.1:48174 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 10:46:51.819680 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 17017
I20260806 10:46:51.820811 17114 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:51.928664 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 17017
I20260806 10:46:51.952668 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 17134
I20260806 10:46:51.953742 17238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:52.060497 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 17134
2026-08-06T10:46:52Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5163 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 10:46:52 dist-test-slave-fgb3 krb5kdc[17547](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 10:46:52 dist-test-slave-fgb3 krb5kdc[17547](info): set up 2 sockets
Aug 06 10:46:52 dist-test-slave-fgb3 krb5kdc[17547](info): commencing operation
krb5kdc: starting...
W20260806 10:46:53.274047 16565 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.001s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/test-user.keytab.
Aug 06 10:46:53 dist-test-slave-fgb3 krb5kdc[17547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T10:46:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T10:46:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
Entry for principal kudu/127.16.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab.
I20260806 10:46:53.602139 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:41891
--webserver_interface=127.16.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:41891,127.16.45.125:35993,127.16.45.124:40749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 10:46:53.941567 17567 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 10:46:53.941910 17567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:53.941985 17567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:53.942067 17567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:53.949623 17567 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:53.949717 17567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:53.949774 17567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:53.949832 17567 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:53.949894 17567 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:53.960045 17567 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:41891,127.16.45.125:35993,127.16.45.124:40749
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.126.keytab
--principal=kudu/127.16.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.126:41891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:53.961323 17567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:53.962625 17567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:53.973958 17573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:53.974020 17574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:53.974071 17576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:53.975163 17567 server_base.cc:1034] running on GCE node
I20260806 10:46:53.975962 17567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:53.977332 17567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:53.978549 17567 hybrid_clock.cc:648] HybridClock initialized: now 1786013213978485 us; error 32 us; skew 500 ppm
I20260806 10:46:53.978869 17567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:53 dist-test-slave-fgb3 krb5kdc[17547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013213, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:53.982092 17567 init.cc:377] Logged in from keytab as kudu/127.16.45.126@KRBTEST.COM (short username kudu)
I20260806 10:46:53.983660 17567 webserver.cc:460] Webserver started at http://127.16.45.126:35275/ using document root <none> and password file <none>
I20260806 10:46:53.984383 17567 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:53.984486 17567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:53.984803 17567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:53.987849 17567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/data/instance:
uuid: "87f302e16b2946939174b55257b01a13"
format_stamp: "Formatted at 2026-08-06 10:46:53 on dist-test-slave-fgb3"
server_key: "4bd2605ae0fb6931df9ddab4bd56a393"
server_key_iv: "d3768a9b27a2fb076521428683022d63"
server_key_version: "encryptionkey@0"
I20260806 10:46:53.988623 17567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/wal/instance:
uuid: "87f302e16b2946939174b55257b01a13"
format_stamp: "Formatted at 2026-08-06 10:46:53 on dist-test-slave-fgb3"
server_key: "4bd2605ae0fb6931df9ddab4bd56a393"
server_key_iv: "d3768a9b27a2fb076521428683022d63"
server_key_version: "encryptionkey@0"
I20260806 10:46:53.993817 17567 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260806 10:46:53.997510 17586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:53.999058 17567 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:46:53.999221 17567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/wal
uuid: "87f302e16b2946939174b55257b01a13"
format_stamp: "Formatted at 2026-08-06 10:46:53 on dist-test-slave-fgb3"
server_key: "4bd2605ae0fb6931df9ddab4bd56a393"
server_key_iv: "d3768a9b27a2fb076521428683022d63"
server_key_version: "encryptionkey@0"
I20260806 10:46:53.999435 17567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:54.018514 17567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:54.023402 17567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:54.023705 17567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:54.042690 17567 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.126:41891
I20260806 10:46:54.042716 17663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.126:41891 every 8 connection(s)
I20260806 10:46:54.044121 17567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/data/info.pb
I20260806 10:46:54.045609 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 17567
I20260806 10:46:54.045800 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-0/wal/instance
I20260806 10:46:54.046420 16565 external_mini_cluster.cc:1428] Setting key 61f84a70cad1431bf5b7f09e977c89b9
I20260806 10:46:54.049028 17664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:54.058029 17664 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:46:54 dist-test-slave-fgb3 krb5kdc[17547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013213, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.45.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.125@KRBTEST.COM" created.
I20260806 10:46:54.082002 17670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.062042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60200 (local address 127.16.45.126:41891)
0806 10:46:54.063235 (+ 1193us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:54.063243 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:54.063290 (+ 47us) server_negotiation.cc:407] Connection header received
0806 10:46:54.065368 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:54.065374 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:54.065640 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:54.065822 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:54.067202 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.068672 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.070105 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.070730 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.070911 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:54.074373 (+ 3462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:54.074383 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:54.074396 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:54.074428 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:54.077434 (+ 3006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:54.078150 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:54.078157 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:54.078159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:54.078337 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:54.078827 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:54.078831 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:54.078833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:54.079411 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:54.079601 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:54.080162 (+ 561us) server_negotiation.cc:299] Negotiation successful
0806 10:46:54.080515 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":988,"spinlock_wait_cycles":17280,"thread_start_us":755,"threads_started":1}
I20260806 10:46:54.082041 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.062042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:41891 (local address 127.0.0.1:60200)
0806 10:46:54.063065 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.063128 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:54.064973 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:54.065867 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:54.065874 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:54.066635 (+ 761us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:54.066992 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:54.067015 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.068851 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.068855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:54.069956 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:54.069975 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.070978 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.070986 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:54.071151 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:54.071826 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:54.071849 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:54.074109 (+ 2260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:54.077575 (+ 3466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:54.077587 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:54.077601 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:54.078024 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:54.078486 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:54.078492 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:54.078495 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:54.078697 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:54.079582 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:54.079590 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:54.079788 (+ 198us) client_negotiation.cc:769] Sending connection context
0806 10:46:54.080019 (+ 231us) client_negotiation.cc:240] Negotiation successful
0806 10:46:54.080658 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"mutex_wait_us":144,"thread_start_us":408,"threads_started":1}
I20260806 10:46:54.085544 17664 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } has no permanent_uuid. Determining permanent_uuid...
I20260806 10:46:54.086724 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.086266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47324)
0806 10:46:54.086492 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.086604 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
W20260806 10:46:54.086966 17590 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
I20260806 10:46:54.088560 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.088200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47328)
0806 10:46:54.088343 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.088418 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 10:46:54.088759 17664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:35993: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.125.keytab.
Entry for principal kudu/127.16.45.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.125.keytab.
I20260806 10:46:54.120124 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.125:35993
--webserver_interface=127.16.45.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.125.keytab
--principal=kudu/127.16.45.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:41891,127.16.45.125:35993,127.16.45.124:40749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:46:54.138167 17664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } attempt: 1
I20260806 10:46:54.139606 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.139017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47340)
0806 10:46:54.139253 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.139420 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260806 10:46:54.140734 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.140327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47350)
0806 10:46:54.140500 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.140581 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260806 10:46:54.140969 17664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:35993: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
I20260806 10:46:54.209256 17664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } attempt: 2
I20260806 10:46:54.210628 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.209992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47366)
0806 10:46:54.210269 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.210446 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260806 10:46:54.211726 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.211278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47380)
0806 10:46:54.211465 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.211555 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 10:46:54.211944 17664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:35993: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
I20260806 10:46:54.303196 17664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } attempt: 3
I20260806 10:46:54.304464 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.303934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47382)
0806 10:46:54.304170 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.304286 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 10:46:54.305603 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.305179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47384)
0806 10:46:54.305339 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.305436 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 10:46:54.305791 17664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:35993: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
I20260806 10:46:54.449051 17664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } attempt: 4
I20260806 10:46:54.450400 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.449743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47396)
0806 10:46:54.450075 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.450184 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166}
I20260806 10:46:54.451480 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.451085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47408)
0806 10:46:54.451234 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.451319 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 10:46:54.451689 17664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.125:35993: Network error: Client connection negotiation failed: client connection to 127.16.45.125:35993: connect: Connection refused (error 111)
W20260806 10:46:54.455271 17673 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 10:46:54.455605 17673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:54.455698 17673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:54.455813 17673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 10:46:54.463264 17673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:54.463359 17673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:54.463441 17673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:54.463508 17673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:54.463591 17673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:54.474094 17673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:41891,127.16.45.125:35993,127.16.45.124:40749
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.125.keytab
--principal=kudu/127.16.45.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.125:35993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.16.45.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:54.475478 17673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:54.476783 17673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 10:46:54.488428 17682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:54.488456 17684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:54.488540 17687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:54.489234 17673 server_base.cc:1034] running on GCE node
I20260806 10:46:54.490043 17673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:54.491523 17673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:54.492741 17673 hybrid_clock.cc:648] HybridClock initialized: now 1786013214492672 us; error 51 us; skew 500 ppm
I20260806 10:46:54.493077 17673 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:54 dist-test-slave-fgb3 krb5kdc[17547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013214, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:54.496248 17673 init.cc:377] Logged in from keytab as kudu/127.16.45.125@KRBTEST.COM (short username kudu)
I20260806 10:46:54.497740 17673 webserver.cc:460] Webserver started at http://127.16.45.125:44805/ using document root <none> and password file <none>
I20260806 10:46:54.498478 17673 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:54.498589 17673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:54.498898 17673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:54.501837 17673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/data/instance:
uuid: "345d228712fd45cfbfcfa91892499044"
format_stamp: "Formatted at 2026-08-06 10:46:54 on dist-test-slave-fgb3"
server_key: "ac104e77e8c92a6288e31f13d764026f"
server_key_iv: "d6d23a492ff6e010ffc83549a8652250"
server_key_version: "encryptionkey@0"
I20260806 10:46:54.502800 17673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/wal/instance:
uuid: "345d228712fd45cfbfcfa91892499044"
format_stamp: "Formatted at 2026-08-06 10:46:54 on dist-test-slave-fgb3"
server_key: "ac104e77e8c92a6288e31f13d764026f"
server_key_iv: "d6d23a492ff6e010ffc83549a8652250"
server_key_version: "encryptionkey@0"
I20260806 10:46:54.508229 17673 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 10:46:54.511837 17700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:54.513243 17673 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 10:46:54.513419 17673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/wal
uuid: "345d228712fd45cfbfcfa91892499044"
format_stamp: "Formatted at 2026-08-06 10:46:54 on dist-test-slave-fgb3"
server_key: "ac104e77e8c92a6288e31f13d764026f"
server_key_iv: "d6d23a492ff6e010ffc83549a8652250"
server_key_version: "encryptionkey@0"
I20260806 10:46:54.513633 17673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:54.536036 17673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:54.540391 17673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:54.540655 17673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:54.558393 17673 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.125:35993
I20260806 10:46:54.558413 17780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.125:35993 every 8 connection(s)
I20260806 10:46:54.559778 17673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/data/info.pb
I20260806 10:46:54.563524 17781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:54.563971 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 17673
I20260806 10:46:54.564148 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-1/wal/instance
I20260806 10:46:54.564586 16565 external_mini_cluster.cc:1428] Setting key 863a645dc2e30048a2c93539fd4e2845
I20260806 10:46:54.570111 17781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:46:54 dist-test-slave-fgb3 krb5kdc[17547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013214, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.125@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:46:54.590411 17670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.572685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60204 (local address 127.16.45.126:41891)
0806 10:46:54.572846 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:54.572850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:54.574284 (+ 1434us) server_negotiation.cc:407] Connection header received
0806 10:46:54.576163 (+ 1879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:54.576169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:54.576249 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:54.576338 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:54.577858 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.578634 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.580147 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.580564 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.580654 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:54.584707 (+ 4053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:54.584712 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:54.584715 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:54.584748 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:54.587330 (+ 2582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:54.588166 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:54.588169 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:54.588171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:54.588283 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:54.588743 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:54.588747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:54.588749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:54.589016 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:54.589123 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:54.589971 (+ 848us) server_negotiation.cc:299] Negotiation successful
0806 10:46:54.590140 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 10:46:54.591814 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.573328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:41891 (local address 127.0.0.1:60204)
0806 10:46:54.574111 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.574149 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:54.575893 (+ 1744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:54.576586 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:54.576594 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:54.577106 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:54.577665 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:54.577685 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.578792 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.578797 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:54.580019 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:54.580039 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.580775 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.580782 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:54.581073 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:54.581748 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:54.581774 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:54.584479 (+ 2705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:54.587480 (+ 3001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:54.587489 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:54.587506 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:54.588070 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:54.588381 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:54.588386 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:54.588390 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:54.588646 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:54.589131 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:54.589139 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:54.589559 (+ 420us) client_negotiation.cc:769] Sending connection context
0806 10:46:54.589910 (+ 351us) client_negotiation.cc:240] Negotiation successful
0806 10:46:54.590432 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":326,"threads_started":1}
I20260806 10:46:54.593568 17781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.16.45.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.45.124@KRBTEST.COM" created.
Aug 06 10:46:54 dist-test-slave-fgb3 krb5kdc[17547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013214, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.125@KRBTEST.COM for kudu/127.16.45.125@KRBTEST.COM
I20260806 10:46:54.608605 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.594425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47422)
0806 10:46:54.594617 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.594635 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:54.594736 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:54.595647 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:54.595652 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:54.596100 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:54.596271 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:54.596282 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.597626 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.597631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:54.598733 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:54.598746 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.599588 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.599592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:54.599710 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:54.600169 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:54.600183 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:54.602393 (+ 2210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:54.605972 (+ 3579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:54.605978 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:54.605982 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:54.606457 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:54.606847 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:54.606851 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:54.606854 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:54.607024 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:54.607664 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:54.607669 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:54.607809 (+ 140us) client_negotiation.cc:769] Sending connection context
0806 10:46:54.607936 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 10:46:54.608181 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 10:46:54.609079 17788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.594630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47422 (local address 127.16.45.125:35993)
0806 10:46:54.595242 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:54.595247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:54.595271 (+ 24us) server_negotiation.cc:407] Connection header received
0806 10:46:54.595312 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:54.595317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:54.595487 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:54.595595 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:54.596440 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.597484 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.598853 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.599469 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.599564 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:54.602617 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:54.602632 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:54.602649 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:54.602683 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:54.605820 (+ 3137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:54.606601 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:54.606609 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:54.606612 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:54.606750 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:54.607133 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:54.607137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:54.607139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:54.607544 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:54.607738 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:54.608113 (+ 375us) server_negotiation.cc:299] Negotiation successful
0806 10:46:54.608342 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":338,"threads_started":1}
I20260806 10:46:54.611425 17781 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } has no permanent_uuid. Determining permanent_uuid...
I20260806 10:46:54.612465 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.612032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52210)
0806 10:46:54.612198 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.612307 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260806 10:46:54.612697 17701 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
I20260806 10:46:54.614094 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.613812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52212)
0806 10:46:54.613933 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.614005 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 10:46:54.614306 17781 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:40749: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.45.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.124.keytab.
Entry for principal kudu/127.16.45.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.124.keytab.
I20260806 10:46:54.641161 16565 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskYt67r8/build/asan/bin/kudu
/tmp/dist-test-taskYt67r8/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.124:40749
--webserver_interface=127.16.45.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.124.keytab
--principal=kudu/127.16.45.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.45.84:41161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.45.126:41891,127.16.45.125:35993,127.16.45.124:40749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 10:46:54.663669 17781 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } attempt: 1
I20260806 10:46:54.664942 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.664456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52216)
0806 10:46:54.664666 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.664781 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260806 10:46:54.666154 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.665686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52228)
0806 10:46:54.665949 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.666038 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260806 10:46:54.666396 17781 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:40749: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
I20260806 10:46:54.734648 17781 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } attempt: 2
I20260806 10:46:54.736006 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.735506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52244)
0806 10:46:54.735744 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.735843 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260806 10:46:54.737039 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.736699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52256)
0806 10:46:54.736849 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.736923 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 10:46:54.737252 17781 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:40749: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
I20260806 10:46:54.750923 17664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } attempt: 5
Aug 06 10:46:54 dist-test-slave-fgb3 krb5kdc[17547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013213, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for kudu/127.16.45.125@KRBTEST.COM
I20260806 10:46:54.763623 17788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.751700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47426 (local address 127.16.45.125:35993)
0806 10:46:54.751871 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:54.751877 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:54.751975 (+ 98us) server_negotiation.cc:407] Connection header received
0806 10:46:54.752159 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:54.752163 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:54.752256 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:54.752352 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:54.753147 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.753871 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.755051 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.755503 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.755616 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:54.758685 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:54.758690 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:54.758693 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:54.758724 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:54.761156 (+ 2432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:54.761759 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:54.761765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:54.761768 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:54.761889 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:54.762229 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:54.762235 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:54.762238 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:54.762573 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:54.762707 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:54.763104 (+ 397us) server_negotiation.cc:299] Negotiation successful
0806 10:46:54.763320 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 10:46:54.763617 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.751651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47426)
0806 10:46:54.751876 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.751896 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:54.752036 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:54.752398 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:54.752404 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:54.752795 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:54.752995 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:54.753004 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.754004 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.754010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:54.754895 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:54.754916 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:54.755648 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:54.755655 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:54.755846 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:54.756410 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:54.756428 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:54.758507 (+ 2079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:54.761282 (+ 2775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:54.761288 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:54.761292 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:54.761651 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:54.761994 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:54.761999 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:54.762002 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:54.762130 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:54.762685 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:54.762690 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:54.762837 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 10:46:54.762986 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 10:46:54.763263 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 10:46:54.764743 17664 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } has no permanent_uuid. Determining permanent_uuid...
I20260806 10:46:54.765836 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.765466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52262)
0806 10:46:54.765619 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.765694 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 10:46:54.766781 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.766472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52268)
0806 10:46:54.766606 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.766685 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 10:46:54.766971 17664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:40749: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
I20260806 10:46:54.818185 17664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } attempt: 1
I20260806 10:46:54.819387 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.818886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52280)
0806 10:46:54.819080 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.819187 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 10:46:54.820479 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.820128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52292)
0806 10:46:54.820277 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.820374 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 10:46:54.820683 17664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:40749: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
I20260806 10:46:54.828452 17781 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } attempt: 3
I20260806 10:46:54.829573 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.829122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52300)
0806 10:46:54.829321 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.829427 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 10:46:54.830579 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.830128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52304)
0806 10:46:54.830375 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.830454 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
W20260806 10:46:54.830781 17781 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:40749: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
I20260806 10:46:54.888907 17664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } attempt: 2
I20260806 10:46:54.890137 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.889613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52314)
0806 10:46:54.889885 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.889976 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260806 10:46:54.891157 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.890829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52330)
0806 10:46:54.890979 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.891049 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 10:46:54.891372 17664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:40749: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
W20260806 10:46:54.973376 17791 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 10:46:54.973722 17791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 10:46:54.973824 17791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 10:46:54.973944 17791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260806 10:46:54.973999 17781 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } attempt: 4
I20260806 10:46:54.975278 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.974723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52346)
0806 10:46:54.974940 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.975039 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 10:46:54.976280 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.975933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52362)
0806 10:46:54.976080 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.976156 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 10:46:54.976509 17781 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:40749: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
W20260806 10:46:54.981559 17791 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 10:46:54.981633 17791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 10:46:54.981715 17791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 10:46:54.981775 17791 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 10:46:54.981858 17791 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 10:46:54.991598 17791 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.45.84:41161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.16.45.126:41891,127.16.45.125:35993,127.16.45.124:40749
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/krb5kdc/kudu_127.16.45.124.keytab
--principal=kudu/127.16.45.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.45.124:40749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.16.45.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 09:53:15 UTC on ccycloud.quasar-vudqhy.root.comops.site
build id 4570067
ASAN enabled
I20260806 10:46:54.992856 17791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 10:46:54.994169 17791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 10:46:54.997632 17664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } attempt: 3
I20260806 10:46:54.998939 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.998439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52368)
0806 10:46:54.998662 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:54.998753 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 10:46:55.000247 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:54.999814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52376)
0806 10:46:55.000050 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:55.000131 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260806 10:46:55.000510 17664 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.45.124:40749: Network error: Client connection negotiation failed: client connection to 127.16.45.124:40749: connect: Connection refused (error 111)
W20260806 10:46:55.007114 17798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:55.007068 17801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 10:46:55.007068 17799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 10:46:55.007977 17791 server_base.cc:1034] running on GCE node
I20260806 10:46:55.008819 17791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 10:46:55.010460 17791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 10:46:55.011704 17791 hybrid_clock.cc:648] HybridClock initialized: now 1786013215011613 us; error 60 us; skew 500 ppm
I20260806 10:46:55.012049 17791 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 10:46:55 dist-test-slave-fgb3 krb5kdc[17547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013215, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 10:46:55.018796 17791 init.cc:377] Logged in from keytab as kudu/127.16.45.124@KRBTEST.COM (short username kudu)
I20260806 10:46:55.020426 17791 webserver.cc:460] Webserver started at http://127.16.45.124:33381/ using document root <none> and password file <none>
I20260806 10:46:55.021140 17791 fs_manager.cc:359] Metadata directory not provided
I20260806 10:46:55.021248 17791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 10:46:55.021574 17791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 10:46:55.024595 17791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/data/instance:
uuid: "6136e3188fe8429cb49c696794b82869"
format_stamp: "Formatted at 2026-08-06 10:46:55 on dist-test-slave-fgb3"
server_key: "16210478331f0803e26f53fcd970b5bf"
server_key_iv: "c332de91e6c80d1181e5404fabc76dbc"
server_key_version: "encryptionkey@0"
I20260806 10:46:55.025352 17791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/wal/instance:
uuid: "6136e3188fe8429cb49c696794b82869"
format_stamp: "Formatted at 2026-08-06 10:46:55 on dist-test-slave-fgb3"
server_key: "16210478331f0803e26f53fcd970b5bf"
server_key_iv: "c332de91e6c80d1181e5404fabc76dbc"
server_key_version: "encryptionkey@0"
I20260806 10:46:55.030436 17791 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260806 10:46:55.033839 17812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 10:46:55.035156 17791 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 10:46:55.035320 17791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/data,/tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/wal
uuid: "6136e3188fe8429cb49c696794b82869"
format_stamp: "Formatted at 2026-08-06 10:46:55 on dist-test-slave-fgb3"
server_key: "16210478331f0803e26f53fcd970b5bf"
server_key_iv: "c332de91e6c80d1181e5404fabc76dbc"
server_key_version: "encryptionkey@0"
I20260806 10:46:55.035523 17791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 10:46:55.076324 17791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 10:46:55.080726 17791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 10:46:55.080991 17791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 10:46:55.099032 17791 rpc_server.cc:307] RPC server started. Bound to: 127.16.45.124:40749
I20260806 10:46:55.099064 17895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.45.124:40749 every 8 connection(s)
I20260806 10:46:55.100355 17791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/data/info.pb
I20260806 10:46:55.103735 16565 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskYt67r8/build/asan/bin/kudu as pid 17791
I20260806 10:46:55.103924 16565 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskYt67r8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786012840862403-16565-0/minicluster-data/master-2/wal/instance
I20260806 10:46:55.104417 17896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 10:46:55.104517 16565 external_mini_cluster.cc:1428] Setting key 3c0b2e5219352229c84579d6f35a9f95
I20260806 10:46:55.113992 17896 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:46:55 dist-test-slave-fgb3 krb5kdc[17547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.124@KRBTEST.COM
Aug 06 10:46:55 dist-test-slave-fgb3 krb5kdc[17547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013215, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.124@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
I20260806 10:46:55.128257 17903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.106291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52390 (local address 127.16.45.124:40749)
0806 10:46:55.107115 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.107126 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.107171 (+ 45us) server_negotiation.cc:407] Connection header received
0806 10:46:55.109093 (+ 1922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.109116 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.109522 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.109858 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.111707 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.112994 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.114810 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.115520 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.115646 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.120403 (+ 4757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:55.120410 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:55.120421 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:55.120467 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:55.123990 (+ 3523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.124666 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.124674 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.124683 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.124856 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.125257 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.125261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.125264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.125774 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:55.126078 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:55.126511 (+ 433us) server_negotiation.cc:299] Negotiation successful
0806 10:46:55.126931 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":360,"threads_started":1}
I20260806 10:46:55.132367 17909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.116909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.126:41891 (local address 127.0.0.1:60206)
0806 10:46:55.118076 (+ 1167us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:55.118134 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:55.118293 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:55.118680 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:55.118687 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:55.119288 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:55.119606 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:55.119619 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.120667 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.120677 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:55.121961 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:55.121976 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.122848 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.122854 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:55.123022 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.123609 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:55.123646 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:55.125887 (+ 2241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:55.129556 (+ 3669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:55.129566 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:55.129572 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:55.130136 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:55.130535 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:55.130540 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:55.130543 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:55.130714 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:55.131248 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:55.131256 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:55.131458 (+ 202us) client_negotiation.cc:769] Sending connection context
0806 10:46:55.131645 (+ 187us) client_negotiation.cc:240] Negotiation successful
0806 10:46:55.131961 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":863,"thread_start_us":682,"threads_started":1}
I20260806 10:46:55.132419 17907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.116915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60206 (local address 127.16.45.126:41891)
0806 10:46:55.117411 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.117417 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.118227 (+ 810us) server_negotiation.cc:407] Connection header received
0806 10:46:55.118426 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.118430 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.118493 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.118576 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.119766 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.120513 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.122112 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.122656 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.122756 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.126074 (+ 3318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:55.126079 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:55.126082 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:55.126115 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:55.129412 (+ 3297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.130249 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.130253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.130255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.130433 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.130832 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.130836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.130839 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.131112 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:55.131232 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:55.131783 (+ 551us) server_negotiation.cc:299] Negotiation successful
0806 10:46:55.132010 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":247,"threads_started":1}
I20260806 10:46:55.134212 17896 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:46:55 dist-test-slave-fgb3 krb5kdc[17547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.126@KRBTEST.COM
Aug 06 10:46:55 dist-test-slave-fgb3 krb5kdc[17547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013215, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.124@KRBTEST.COM for kudu/127.16.45.125@KRBTEST.COM
I20260806 10:46:55.146560 17907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.131588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60218 (local address 127.16.45.126:41891)
0806 10:46:55.132633 (+ 1045us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.132638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.132656 (+ 18us) server_negotiation.cc:407] Connection header received
0806 10:46:55.132703 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.132708 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.132802 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.132897 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.134097 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.134917 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.136153 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.136568 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.136657 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.141313 (+ 4656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:55.141318 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:55.141321 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:55.141360 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:55.143933 (+ 2573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.144562 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.144567 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.144570 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.144685 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.145125 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.145128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.145130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.145420 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:55.145699 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:55.145967 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 10:46:55.146189 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":947,"thread_start_us":1500,"threads_started":1}
I20260806 10:46:55.147315 17788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.134971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47432 (local address 127.16.45.125:35993)
0806 10:46:55.135146 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.135151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.135170 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:46:55.135230 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.135235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.135302 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.135389 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.136195 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.136983 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.138270 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.138944 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.139069 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.142219 (+ 3150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:55.142224 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:55.142227 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:55.142260 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:55.144767 (+ 2507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.145429 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.145434 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.145437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.145596 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.145999 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.146004 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.146007 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.146396 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:55.146554 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:55.146906 (+ 352us) server_negotiation.cc:299] Negotiation successful
0806 10:46:55.147061 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 10:46:55.147405 17909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.134869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.125:35993 (local address 127.0.0.1:47432)
0806 10:46:55.135033 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:55.135051 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:55.135141 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:55.135442 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:55.135447 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:55.135858 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:55.136032 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:55.136043 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.137142 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.137147 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:55.138111 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:55.138123 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.139115 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.139122 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:55.139271 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.139787 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:55.139805 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:55.142037 (+ 2232us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:55.144875 (+ 2838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:55.144880 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:55.144883 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:55.145298 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:55.145706 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:55.145711 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:55.145714 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:55.145893 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:55.146532 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:55.146535 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:55.146661 (+ 126us) client_negotiation.cc:769] Sending connection context
0806 10:46:55.146803 (+ 142us) client_negotiation.cc:240] Negotiation successful
0806 10:46:55.147080 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 10:46:55.148284 17896 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 10:46:55 dist-test-slave-fgb3 krb5kdc[17547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013215, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.124@KRBTEST.COM for kudu/127.16.45.124@KRBTEST.COM
Aug 06 10:46:55 dist-test-slave-fgb3 krb5kdc[17547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.45.125@KRBTEST.COM
I20260806 10:46:55.162285 17909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.149071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52406)
0806 10:46:55.149202 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:55.149219 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:55.149314 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:55.149582 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:55.149586 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:55.150011 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:55.150185 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:55.150196 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.151389 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.151394 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:55.152561 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:55.152575 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.153247 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.153252 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:55.153421 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.154000 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:55.154023 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:55.156475 (+ 2452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:55.159732 (+ 3257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:55.159737 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:55.159742 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:55.160221 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:55.160682 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:55.160687 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:55.160691 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:55.160858 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:55.161413 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:55.161418 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:55.161575 (+ 157us) client_negotiation.cc:769] Sending connection context
0806 10:46:55.161695 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 10:46:55.161933 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 10:46:55.162571 17903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.148988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52406 (local address 127.16.45.124:40749)
0806 10:46:55.149153 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.149158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.149276 (+ 118us) server_negotiation.cc:407] Connection header received
0806 10:46:55.149414 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.149417 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.149468 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.149535 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.150333 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.151244 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.152702 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.153094 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.153201 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.156660 (+ 3459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:55.156665 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:55.156668 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:55.156697 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:55.159607 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.160413 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.160418 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.160420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.160552 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.160972 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.160976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.160978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.161299 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:55.161407 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:55.161828 (+ 421us) server_negotiation.cc:299] Negotiation successful
0806 10:46:55.162115 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":58}
I20260806 10:46:55.164386 17788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.148575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47444 (local address 127.16.45.125:35993)
0806 10:46:55.148723 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.148728 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.148745 (+ 17us) server_negotiation.cc:407] Connection header received
0806 10:46:55.148932 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.148937 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.149005 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.149094 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.150711 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.151730 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.153207 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.153715 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.153829 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.158587 (+ 4758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:55.158591 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:55.158594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:55.158626 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:55.161349 (+ 2723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.162100 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.162106 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.162109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.162288 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.162853 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.162858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.162862 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.163133 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:55.163341 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:55.163880 (+ 539us) server_negotiation.cc:299] Negotiation successful
0806 10:46:55.164103 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 10:46:55.167907 17896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869: Bootstrap starting.
I20260806 10:46:55.169155 16565 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 10:46:55.171733 17896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:55.172884 17896 log.cc:824] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:55.172267 17626 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "87f302e16b2946939174b55257b01a13"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60218
I20260806 10:46:55.175843 17896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869: No bootstrap required, opened a new log
I20260806 10:46:55.177740 17664 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } attempt: 4
I20260806 10:46:55.184468 17896 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } }
I20260806 10:46:55.184904 17896 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6136e3188fe8429cb49c696794b82869, State: Initialized, Role: FOLLOWER
I20260806 10:46:55.185425 17896 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } }
Aug 06 10:46:55 dist-test-slave-fgb3 krb5kdc[17547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013213, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.126@KRBTEST.COM for kudu/127.16.45.124@KRBTEST.COM
I20260806 10:46:55.186426 17913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } } }
I20260806 10:46:55.186813 17913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:55.187741 17896 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:55.193996 17668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.178451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52412)
0806 10:46:55.178638 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:55.178657 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:55.178757 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:55.179077 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:55.179082 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:55.179604 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:55.179808 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:55.179820 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.181298 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.181303 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:55.182833 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:55.182848 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.183868 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.183875 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:55.184092 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.184714 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:55.184732 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:55.187270 (+ 2538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:55.191336 (+ 4066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:55.191342 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:55.191346 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:55.191727 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:55.192175 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:55.192180 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:55.192184 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:55.192364 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:55.192961 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:55.192966 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:55.193159 (+ 193us) client_negotiation.cc:769] Sending connection context
0806 10:46:55.193311 (+ 152us) client_negotiation.cc:240] Negotiation successful
0806 10:46:55.193605 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 10:46:55.194022 17903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.178500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52412 (local address 127.16.45.124:40749)
0806 10:46:55.178769 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.178776 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.178801 (+ 25us) server_negotiation.cc:407] Connection header received
0806 10:46:55.178863 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.178868 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.178938 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.179041 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.179989 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.181152 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.183000 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.183708 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.183831 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.187484 (+ 3653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:55.187491 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:55.187496 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:55.187537 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:55.191186 (+ 3649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.191874 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.191881 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.191884 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.192058 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.192510 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.192515 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.192517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.192807 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:55.192989 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:55.193443 (+ 454us) server_negotiation.cc:299] Negotiation successful
0806 10:46:55.193662 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
W20260806 10:46:55.197815 17929 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 10:46:55.197944 17929 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 10:46:55.199900 17664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13: Bootstrap starting.
I20260806 10:46:55.205108 17664 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:55.206552 17664 log.cc:824] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:55.195859 17791 master_runner.cc:186] Error getting master registration for 127.16.45.126:41891: OK, instance_id { permanent_uuid: "87f302e16b2946939174b55257b01a13" instance_seqno: 1786013214037585 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 10:46:55.206938 17791 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 10:46:55.209554 17664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13: No bootstrap required, opened a new log
I20260806 10:46:55.217178 17664 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } }
I20260806 10:46:55.217548 17664 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87f302e16b2946939174b55257b01a13, State: Initialized, Role: FOLLOWER
I20260806 10:46:55.218068 17664 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } }
I20260806 10:46:55.219126 17932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } } }
I20260806 10:46:55.219622 17932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:55.220359 17664 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:55.220453 17626 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 10:46:55.220649 17626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:55.224210 17626 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } }
I20260806 10:46:55.227180 17855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87f302e16b2946939174b55257b01a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6136e3188fe8429cb49c696794b82869"
I20260806 10:46:55.227749 17855 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:55.231606 17855 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87f302e16b2946939174b55257b01a13 in term 1.
I20260806 10:46:55.232082 17626 leader_election.cc:288] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [CANDIDATE]: Term 1 election: Requested vote from peers 345d228712fd45cfbfcfa91892499044 (127.16.45.125:35993), 6136e3188fe8429cb49c696794b82869 (127.16.45.124:40749)
I20260806 10:46:55.232425 17588 leader_election.cc:302] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6136e3188fe8429cb49c696794b82869, 87f302e16b2946939174b55257b01a13; no voters:
I20260806 10:46:55.233117 17932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 10:46:55.234522 17932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [term 1 LEADER]: Becoming Leader. State: Replica: 87f302e16b2946939174b55257b01a13, State: Running, Role: LEADER
I20260806 10:46:55.235209 17932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } }
I20260806 10:46:55.245411 17944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87f302e16b2946939174b55257b01a13. Latest consensus state: current_term: 1 leader_uuid: "87f302e16b2946939174b55257b01a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } } }
I20260806 10:46:55.246346 17944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:55.250972 17948 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 10:46:55.261960 17948 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 10:46:55.270924 17960 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260806 10:46:55.276875 17593 tablet.cc:2369] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:46:55.282377 17781 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } attempt: 5
Aug 06 10:46:55 dist-test-slave-fgb3 krb5kdc[17547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786013214, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.45.125@KRBTEST.COM for kudu/127.16.45.124@KRBTEST.COM
I20260806 10:46:55.301735 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.283140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.45.124:40749 (local address 127.0.0.1:52414)
0806 10:46:55.283556 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0806 10:46:55.283580 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 10:46:55.283698 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 10:46:55.284628 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 10:46:55.284634 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 10:46:55.285187 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0806 10:46:55.285399 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:55.285411 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.286955 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.286961 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:55.288497 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 10:46:55.288516 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.289792 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.289799 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 10:46:55.290052 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.290802 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 10:46:55.290828 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 10:46:55.294112 (+ 3284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 10:46:55.298567 (+ 4455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:55.298573 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:55.298577 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:55.299191 (+ 614us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:55.299696 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 10:46:55.299702 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 10:46:55.299706 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 10:46:55.299893 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 10:46:55.300623 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 10:46:55.300629 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 10:46:55.300819 (+ 190us) client_negotiation.cc:769] Sending connection context
0806 10:46:55.300978 (+ 159us) client_negotiation.cc:240] Negotiation successful
0806 10:46:55.301316 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278}
I20260806 10:46:55.304127 17903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.283941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52414 (local address 127.16.45.124:40749)
0806 10:46:55.284120 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.284125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.284144 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:46:55.284206 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.284212 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.284319 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.284426 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.285586 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.286749 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.288725 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.289433 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.289556 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.294425 (+ 4869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:55.294434 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:55.294439 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:55.294487 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:55.298305 (+ 3818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.299360 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.299367 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.299371 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.299557 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.300023 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.300029 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.300032 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.300408 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:55.300555 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:55.302253 (+ 1698us) server_negotiation.cc:299] Negotiation successful
0806 10:46:55.302529 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 10:46:55.275588 17567 master_runner.cc:186] Error getting master registration for 127.16.45.125:35993: OK, instance_id { permanent_uuid: "345d228712fd45cfbfcfa91892499044" instance_seqno: 1786013214553340 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 10:46:55.318470 17567 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 10:46:55.324098 17781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044: Bootstrap starting.
W20260806 10:46:55.333253 17822 tablet.cc:2369] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 10:46:55.335759 17781 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044: Neither blocks nor log segments found. Creating new log.
I20260806 10:46:55.345888 17788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.276032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47456 (local address 127.16.45.125:35993)
0806 10:46:55.276213 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.276218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.315411 (+ 39193us) server_negotiation.cc:407] Connection header received
0806 10:46:55.315905 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.315911 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.315999 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.316072 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.321317 (+ 5245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.322522 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.327640 (+ 5118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.328317 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.328446 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.332601 (+ 4155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:55.332608 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:55.332613 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:55.332663 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:55.336156 (+ 3493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.338802 (+ 2646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.338807 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.338810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.338973 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.340401 (+ 1428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.340407 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.340411 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.340795 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:55.341072 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:55.345256 (+ 4184us) server_negotiation.cc:299] Negotiation successful
0806 10:46:55.345528 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 10:46:55.346429 17781 log.cc:824] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044: Log is configured to *not* fsync() on all Append() calls
I20260806 10:46:55.349810 17903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.284158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52418 (local address 127.16.45.124:40749)
0806 10:46:55.304785 (+ 20627us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.304791 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.317827 (+ 13036us) server_negotiation.cc:407] Connection header received
0806 10:46:55.317898 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.317903 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.318007 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.318107 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.324831 (+ 6724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.325839 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.329243 (+ 3404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.329886 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.329988 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.339566 (+ 9578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:55.339573 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:55.339578 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:55.339623 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:55.343721 (+ 4098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.344577 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.344584 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.344588 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.344749 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.347396 (+ 2647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.347401 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.347404 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.347765 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:55.348020 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:55.349181 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0806 10:46:55.349434 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20458,"thread_start_us":27682,"threads_started":1}
I20260806 10:46:55.361939 17781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044: No bootstrap required, opened a new log
I20260806 10:46:55.367189 17907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:55.270063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60220 (local address 127.16.45.126:41891)
0806 10:46:55.270244 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.270251 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.319824 (+ 49573us) server_negotiation.cc:407] Connection header received
0806 10:46:55.319917 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.319922 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.320004 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.320105 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.338353 (+ 18248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.339568 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.346726 (+ 7158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:55.347410 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:55.347512 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:55.359226 (+ 11714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 10:46:55.359241 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 10:46:55.359247 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 10:46:55.359303 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 10:46:55.363167 (+ 3864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.364014 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.364021 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.364025 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.364200 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 10:46:55.364650 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 10:46:55.364655 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 10:46:55.364659 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 10:46:55.365083 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 10:46:55.366441 (+ 1358us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:55.366581 (+ 140us) server_negotiation.cc:299] Negotiation successful
0806 10:46:55.366818 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 10:46:55.368851 17855 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [term 1 FOLLOWER]: Refusing update from remote peer 87f302e16b2946939174b55257b01a13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:46:55.369867 17932 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:46:55.372793 17781 raft_consensus.cc:348] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } }
I20260806 10:46:55.373183 17781 raft_consensus.cc:729] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 345d228712fd45cfbfcfa91892499044, State: Initialized, Role: FOLLOWER
I20260806 10:46:55.373693 17781 consensus_queue.cc:260] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } }
I20260806 10:46:55.388826 17913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87f302e16b2946939174b55257b01a13. Latest consensus state: current_term: 1 leader_uuid: "87f302e16b2946939174b55257b01a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } } }
I20260806 10:46:55.389155 17913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:55.391239 17968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } } }
I20260806 10:46:55.391713 17968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:55.392719 17781 sys_catalog.cc:564] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 10:46:55.393239 17735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [term 0 FOLLOWER]: Advancing to term 1
I20260806 10:46:55.397137 17735 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [term 1 FOLLOWER]: Refusing update from remote peer 87f302e16b2946939174b55257b01a13: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 10:46:55.398000 17736 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87f302e16b2946939174b55257b01a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "345d228712fd45cfbfcfa91892499044"
I20260806 10:46:55.402072 17932 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 10:46:55.405926 17736 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87f302e16b2946939174b55257b01a13 in term 1.
I20260806 10:46:55.424350 17932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "87f302e16b2946939174b55257b01a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } } }
I20260806 10:46:55.424768 17932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:55.427346 17969 mvcc.cc:205] Tried to move back new op lower bound from 7315510130137100288 to 7315510129609785344. Current Snapshot: MvccSnapshot[applied={T|T < 7315510130137100288}]
I20260806 10:46:55.437788 17913 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "87f302e16b2946939174b55257b01a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } } }
I20260806 10:46:55.438118 17913 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:55.444227 17948 catalog_manager.cc:1347] Generated new cluster ID: 8f7383030cd343f88eb7f8700cec32d3
I20260806 10:46:55.444352 17948 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 10:46:55.460024 17968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87f302e16b2946939174b55257b01a13. Latest consensus state: current_term: 1 leader_uuid: "87f302e16b2946939174b55257b01a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } } }
I20260806 10:46:55.460377 17968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:55.462360 17944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "87f302e16b2946939174b55257b01a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } } }
I20260806 10:46:55.462649 17944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13 [sys.catalog]: This master's current role is: LEADER
I20260806 10:46:55.475899 17968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "87f302e16b2946939174b55257b01a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87f302e16b2946939174b55257b01a13" member_type: VOTER last_known_addr { host: "127.16.45.126" port: 41891 } } peers { permanent_uuid: "345d228712fd45cfbfcfa91892499044" member_type: VOTER last_known_addr { host: "127.16.45.125" port: 35993 } } peers { permanent_uuid: "6136e3188fe8429cb49c696794b82869" member_type: VOTER last_known_addr { host: "127.16.45.124" port: 40749 } } }
I20260806 10:46:55.476202 17968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 10:46:55.489094 17948 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 10:46:55.492147 17948 catalog_manager.cc:1504] Loading token signing keys...
I20260806 10:46:55.507124 17991 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 10:46:55.510871 17948 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87f302e16b2946939174b55257b01a13: Generated new TSK 0
I20260806 10:46:55.513423 17948 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 10:46:55.627588 17907 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:55.614201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60232 (local address 127.16.45.126:41891)
0806 10:46:55.614502 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.614508 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.625212 (+ 10704us) server_negotiation.cc:407] Connection header received
0806 10:46:55.625798 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.625805 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.625933 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.626012 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.627324 (+ 1312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60232: BlockingRecv error: recv got EOF from 127.0.0.1:60232 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260806 10:46:55.631157 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:55.614460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47460 (local address 127.16.45.125:35993)
0806 10:46:55.614662 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.614669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.629110 (+ 14441us) server_negotiation.cc:407] Connection header received
0806 10:46:55.629369 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.629375 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.629476 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.629547 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.630916 (+ 1369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47460: BlockingRecv error: recv got EOF from 127.0.0.1:47460 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260806 10:46:55.631246 17903 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:55.613798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52424 (local address 127.16.45.124:40749)
0806 10:46:55.613994 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.614000 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.628577 (+ 14577us) server_negotiation.cc:407] Connection header received
0806 10:46:55.629553 (+ 976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.629559 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.629672 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.629762 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.630999 (+ 1237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52424: BlockingRecv error: recv got EOF from 127.0.0.1:52424 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260806 10:46:55.638852 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:55.636577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47470 (local address 127.16.45.125:35993)
0806 10:46:55.636748 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.636754 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.637230 (+ 476us) server_negotiation.cc:407] Connection header received
0806 10:46:55.637437 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.637443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.637576 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.637681 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.638543 (+ 862us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47470: BlockingRecv error: recv got EOF from 127.0.0.1:47470 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 10:46:55.645076 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:55.643080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47482 (local address 127.16.45.125:35993)
0806 10:46:55.643244 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.643249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.643728 (+ 479us) server_negotiation.cc:407] Connection header received
0806 10:46:55.643902 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.643908 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.643991 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.644090 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.644874 (+ 784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47482: BlockingRecv error: recv got EOF from 127.0.0.1:47482 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260806 10:46:55.652958 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:55.650800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47498 (local address 127.16.45.125:35993)
0806 10:46:55.650987 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.650993 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.651513 (+ 520us) server_negotiation.cc:407] Connection header received
0806 10:46:55.651717 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.651723 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.651828 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.651937 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.652717 (+ 780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47498: BlockingRecv error: recv got EOF from 127.0.0.1:47498 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260806 10:46:55.662652 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:55.660385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47504 (local address 127.16.45.125:35993)
0806 10:46:55.660594 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.660600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.661147 (+ 547us) server_negotiation.cc:407] Connection header received
0806 10:46:55.661347 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.661353 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.661438 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.661541 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.662436 (+ 895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47504: BlockingRecv error: recv got EOF from 127.0.0.1:47504 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
W20260806 10:46:55.677207 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:55.674953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47516 (local address 127.16.45.125:35993)
0806 10:46:55.675159 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.675165 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.675676 (+ 511us) server_negotiation.cc:407] Connection header received
0806 10:46:55.675879 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.675885 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.675982 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.676097 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.676964 (+ 867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47516: BlockingRecv error: recv got EOF from 127.0.0.1:47516 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260806 10:46:55.703218 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:55.700761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47526 (local address 127.16.45.125:35993)
0806 10:46:55.700974 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.700981 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.701515 (+ 534us) server_negotiation.cc:407] Connection header received
0806 10:46:55.701739 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.701746 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.701847 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.701987 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.702943 (+ 956us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47526: BlockingRecv error: recv got EOF from 127.0.0.1:47526 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260806 10:46:55.747020 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:55.744552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47542 (local address 127.16.45.125:35993)
0806 10:46:55.744761 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.744767 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.745362 (+ 595us) server_negotiation.cc:407] Connection header received
0806 10:46:55.745576 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.745582 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.745684 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.745805 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.746737 (+ 932us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47542: BlockingRecv error: recv got EOF from 127.0.0.1:47542 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260806 10:46:55.816329 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:55.814558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47556 (local address 127.16.45.125:35993)
0806 10:46:55.814786 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.814793 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.815090 (+ 297us) server_negotiation.cc:407] Connection header received
0806 10:46:55.815252 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.815256 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.815328 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.815435 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.816121 (+ 686us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47556: BlockingRecv error: recv got EOF from 127.0.0.1:47556 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260806 10:46:55.955567 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:55.953588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47560 (local address 127.16.45.125:35993)
0806 10:46:55.953823 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:55.953829 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:55.954116 (+ 287us) server_negotiation.cc:407] Connection header received
0806 10:46:55.954364 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:55.954368 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:55.954466 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:55.954553 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:55.955281 (+ 728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47560: BlockingRecv error: recv got EOF from 127.0.0.1:47560 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 10:46:56.200058 17929 catalog_manager.cc:1259] Loaded cluster ID: 8f7383030cd343f88eb7f8700cec32d3
I20260806 10:46:56.200171 17929 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869: loading cluster ID for follower catalog manager: success
I20260806 10:46:56.202773 17929 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869: acquiring CA information for follower catalog manager: success
I20260806 10:46:56.204891 17929 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6136e3188fe8429cb49c696794b82869: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 10:46:56.217082 17788 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 10:46:56.215323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47564 (local address 127.16.45.125:35993)
0806 10:46:56.215555 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:56.215562 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:56.215721 (+ 159us) server_negotiation.cc:407] Connection header received
0806 10:46:56.215961 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:56.215967 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:56.216040 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:56.216127 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 10:46:56.216860 (+ 733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47564: BlockingRecv error: recv got EOF from 127.0.0.1:47564 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 10:46:56.511652 17991 catalog_manager.cc:1259] Loaded cluster ID: 8f7383030cd343f88eb7f8700cec32d3
I20260806 10:46:56.511790 17991 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044: loading cluster ID for follower catalog manager: success
I20260806 10:46:56.514551 17991 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044: acquiring CA information for follower catalog manager: success
I20260806 10:46:56.516438 17991 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 345d228712fd45cfbfcfa91892499044: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 10:46:56.741706 18097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:56.732863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47566 (local address 127.16.45.125:35993)
0806 10:46:56.734817 (+ 1954us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:56.734823 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:56.735099 (+ 276us) server_negotiation.cc:407] Connection header received
0806 10:46:56.735276 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:56.735283 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:56.735510 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:56.735676 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:56.736094 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:56.737388 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:56.738794 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:56.739509 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:56.739645 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:56.740197 (+ 552us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:56.741027 (+ 830us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:56.741192 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:56.741244 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 10:46:56.741337 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1788,"thread_start_us":1588,"threads_started":1}
I20260806 10:46:56.753659 18108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:56.748082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52440 (local address 127.16.45.124:40749)
0806 10:46:56.748721 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:56.748727 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:56.748746 (+ 19us) server_negotiation.cc:407] Connection header received
0806 10:46:56.748844 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:56.748847 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:56.749012 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:56.749156 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:56.749538 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:56.750224 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:56.751532 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:56.751936 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:56.752052 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:56.752522 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:56.753014 (+ 492us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:56.753142 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:56.753240 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 10:46:56.753322 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":403,"threads_started":1}
I20260806 10:46:56.781527 18108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:56.760329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52446 (local address 127.16.45.124:40749)
0806 10:46:56.760506 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:56.760512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:56.774144 (+ 13632us) server_negotiation.cc:407] Connection header received
0806 10:46:56.774757 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:56.774764 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:56.774875 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:56.774943 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:56.775756 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:56.776811 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:56.779012 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:56.779649 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:56.779772 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:56.780657 (+ 885us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:56.780789 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:56.780848 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:56.781138 (+ 290us) server_negotiation.cc:299] Negotiation successful
0806 10:46:56.781224 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 10:46:56.782896 18097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:56.760072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47576 (local address 127.16.45.125:35993)
0806 10:46:56.760242 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:56.760249 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:56.775857 (+ 15608us) server_negotiation.cc:407] Connection header received
0806 10:46:56.776327 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:56.776334 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:56.776440 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:56.776499 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:56.777262 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:56.778461 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:56.780470 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:56.781112 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:56.781208 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:56.781952 (+ 744us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:56.782076 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:56.782131 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:56.782506 (+ 375us) server_negotiation.cc:299] Negotiation successful
0806 10:46:56.782596 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 10:46:56.784164 18117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 10:46:56.760001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60240 (local address 127.16.45.126:41891)
0806 10:46:56.773473 (+ 13472us) server_negotiation.cc:206] Beginning negotiation
0806 10:46:56.773480 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 10:46:56.776418 (+ 2938us) server_negotiation.cc:407] Connection header received
0806 10:46:56.776550 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 10:46:56.776556 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 10:46:56.776801 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 10:46:56.776991 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 10:46:56.777862 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:56.779007 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:56.781229 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 10:46:56.781982 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 10:46:56.782107 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 10:46:56.782865 (+ 758us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 10:46:56.783440 (+ 575us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 10:46:56.783562 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 10:46:56.783778 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 10:46:56.783869 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13325,"thread_start_us":14532,"threads_started":1}
I20260806 10:46:56.790096 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 17567
I20260806 10:46:56.791044 17657 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:56.928872 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 17567
I20260806 10:46:56.952924 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 17673
I20260806 10:46:56.954133 17773 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:57.060581 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 17673
I20260806 10:46:57.085310 16565 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskYt67r8/build/asan/bin/kudu pid 17791
I20260806 10:46:57.086515 17891 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 10:46:57.192077 16565 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskYt67r8/build/asan/bin/kudu with pid 17791
2026-08-06T10:46:57Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5132 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10297 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (376261 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST